UNCLASSIFIED 


AD  NUMBER 


AD820392 


NEW  LIMITATION  CHANGE 
TO 

Approved  for  public  release,  distribution 
unlimited 


FROM 

Distribution  authorized  to  U.S.  Gov't, 
agencies  and  their  contractors;  Critical 
Technology;  AUG  1967.  Other  requests  shall 
be  referred  to  Rome  Air  Development 
Center,  ATTN:  EMLI,  Griff iss  AFB,  NY 
13440. 


AUTHORITY 


RADC  ltr  dtd  17  Sep  1971 


THIS  PAGE  IS  UNCLASSIFIED 


AD820392 


OPTIMUM  DEMODULATION  OF  PM  AND  FM  SIGNALS. 


CORNELL  AERONAUTICAL  LAB  INC  BUFFALO  NY 

AUG  1967 

Distribution  Statement  A: 

Approved  for  public  release.  Distribution  is  unlimited. 


1  vr 

,  /we 

7  <- 


ntjywmwj 


3s  '* 


•»£N  'gJMk^**^***  •  «'**  mfp  *M  J  T^Lr-j^pZpgg ?*V^  ” 

>-:w  -  -  :-i;--:-": 

4>«  "l* 


•X  ?!  >5  •  '?. 


-js  ,<L  , 
A.}i 


‘  '7  i 


-  c  _ 


5  •*  ^  '  V  pf'  ’r  '  , 

;  -V*yc  4 


m 


;-X-  '  v-  v- ■  HvVi'3  K- -A4  ;&.y^:-  -.-  v  .:-: ;;-  -4*--  >•  *•-** -4  -,  -.--V  :-  ,  ' 

:*“  i  •  •■?*’ -•*’ii?’-_ -’’  V'i.  ^  <i  -" ■>*.>•' V .•  ^-’V*4  ;  4,43:-  .  |?vii  -v? »  *---’’  i  *'-•  -  . ' 

-  '  .•  1  -y  /  -  -iti  'St  -»■*  3  -  ‘5.9  1  —  .  **■  -  ~z  v. '  «  1  ■*  * 

;f;;  ;4  3^'.^  4g ;  •  V? . , c**^? .-' '?• , -  .-'.4- f-  *  A. ' y  -  ■  ^  ■  ‘ 


;>v 

■-J-V^.s:;:. 


■  t." 


.  -.  "Ay  ? 

;^:>- '  ^ 


..  „  . . .. 


.V 


r-V  H  \^v 


'•-, - ^  '.f«„  ^,n%  *<\t  ;,«r 1  '•i>-’  '  ■■;. .< \zz'* i> 's;" *' ,1’.^' yf* \<?  -y<v»t  •  »r^--  -.  "'-Vs., 

i*.  ■;  .  »,. ' -J?  . -%*  i.  •»  ♦  -«■  /.  . *■*  4..'  -  •o^V'fr' i-»  v  a>  ,.  <"*.  >i  .  > « «/ 

v  j-  rfVt^v.o>  A>;v-  .::Ur  il 

f*''  *****  '.  *■  .  •  *  '•  At.  «,.*  v  '^avS’^/T  c-  ''’■'*<•*»  '’n^  V*  *  O  .•  .  *■ . .s.  *  a*  ,  x!  , 


,$>  '■  ❖  „Vvv  , 


.  1  '  ,  *  I  V,  ,  ^ 

>”  .,  '  .  % 


.>“  »  '■  %.  .^<4  «’  '  ■  ” 

f  sr*  5  -v  ^  X  '  ' 

S:  ■>  J'  ,-fV-  ■ 

i  "■  .  'J'v^  J  ''’•'> '  ,T 

i  -  -o 


^  -v  •■  '-»•.  vkXT'te#  o- 

:.  *'^-.y  V.A* 


»:  ^  ;•>  •*  *'..,•  > 
*  a 


■rjx  fj 

^~'c\  *t>+* 

'  ~o  ■  C- 


,■?  ^'^4;x5  .>  '9;4':Tv*'.'/v:  “:;'s.:v  v-‘  Wv:  ,  ..*• 

_  s  *  .  ,  **  .  -  X;  r  •  '  o.  ^  4  %'  <►  o  T-  -  ,  ,<>  i  s-  *  o  v  _  .i  '  >  *  •*  '  1 

-  '  Vv>  rfO  O'?  •}’v  ’  ^  '  V  ’  />■  .  ''  '->  V_A«  A,  »'  ^  J»  ,»  <*'4  AnTo  ''•'  .  ',  »  „  -  -  ■* 

I  -,„  . .  *  y  o  /-  *  '  .>  •  .  -a->-  -.<.  j\  ^  .  -.  j'-'1  -f^  .  <■,,  .  -■  -£>  4-.  to  5.  v  $  -  -  ' 

1  -  :  -  •':•>'•  .  ...  : . oc  ^  .•>  .  y  4,x-  X4«^,  «-  --'  .'.•/•  , ,,  -:Sv 


:  -■'  5!o-  * 
|  <T  *  O  „■ 


■y  . 


„  •°S','t  ,X'or'; 


‘-0J  ft  •  -* 

vV  0  V  .  'V 
.  _  v  v  „  v  i*  ->M  '003:^ 

#  >  *_  "  *V  ,  «  V5'  -',  v*  S'  ■  .  , 

s„;<  X ^  .>  o  o  i.<k  ^  ■>.'  .  ‘  «a 

-t  /  ,’«  »  •  o  ?$.  ■  s^,.  *  c  'i*  <~,‘'s,-  *  .  ^  ^  0 

*n.  ••»,  .v  „‘-t,;  V  ;  **x^a 

,.i;v  4-v%  e.; 

,ct  ,  *  •  <-  "  >  0  -  V  vV- 

a'**?  1  **  '*’  '  v* 


"  ■>’  . 

?  i. 

<‘S-  o  c  »T 


d- 

*'.s- 


O  V  ✓ 


**o  o* 


%y  <  p  '0.3  - '  -  \^.o' '  r;  4  - 
J  =  "-„  «•*  '>0  .  <x  "■>  <^  :  v  -  '■  '- 

o  0  -  ® .  •■  .  v  v  >  •  -r  w  v '  o  .  '- 

•  :‘o-  <■  X  J-  O  ^  4  .  *  -■ 

■.  "“  ,  '  "o-'  ,,  “  -i4  X>~p 

v  y  •>  *  a  .  y  ^  ^  v  o  a  -v 


r 


^ ik  »J%=  'X 


'oe 

;  *^-.vi4«4  '  >v. 

■  o  4-'  ..  *'  ''V  v  VO  ^ 

'~  '  -v  •<;  '3*  .  O^*  *'v  "  ^  .  t  q  ■  i'  y  •  '  ■  •«  ■  r  v 

'"  4s.Aoii  i', .,  *  '  \.  A 4  4°  *.  ?  v« *$;.,•  's"-|*  •  ■  s-  .»hs'  'V"A-'  jS< 

-  J  V:. VC'-'.v^^; 

s-  - -**  '  S’JL' 5?  iii 

"^--  Ts*w  rfiHg 


GPTIMUM  DEMODULATION  OF  PM  AND  FM  SrGNALS 
John  G.  Lawton 

Comefi  Aeronautical  Laboratory,  Inc. 


This  do  cement  is  subject  to  special 
export  controls  and  eadi  transmittal 
to  foreign  governments,  foreign  na¬ 
tionals  or  representatives  thereto  may 
be  made  only  with  prior  sppajval  of 
RADC  (Efc-D*  °AFB,  N.Y.  13440 


me,  cm,  X.T.,  22  8 r?  et-lB) 


t 


FOREWORD 
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ABSTRACT 


This  report  presents  the  results  of  an  investigation  of  the  limiting 
performance  attainable  with  angle  modulation  (PM  and  FM)  systems. 
Estimators  which  implement  the  statistical  criteria  of  minimum  mean- 
square  error  (MMSE)  and  maximum  a  posteriori  probability  (MAP) 
estimation  as  well  as  advanced  but  physically  realizable  demodulators, 
such  as  phase-locked  loops  (PLL),  ai>e  investigated  and  compared. 

Because  of  the  nonlinear  characteristic  of  angle  modulation  it  is  difficult 
to  obtain  analytic  expressions  for  the  performance  of  these  estimators 
which  are  very  useful  at  all  values  of  input  signal-to-noise  ratio.  However, 
separate  asymptotic  expansions  are  obtained  for  the  large  and  the  small 
signal-to-noise  ratio  regions.  The  large  signal-to-noise  ratio  expansion 
is  valid  upward  from  a  point  below  threshold  and  covers  the  range  of 
signal-to-noise  ratios  of  greatest  practical  interest.  An  asymptotic 
formula  valid  for  all  signal-to-noise  ratios  and  small  modulation  indexes 
was  derived;  it  is  compatible  with  and  overlaps  the  domains  of  the  other 
expansions.  The  region  which  could  not  be  effectively  treated  analytically 
was  investigated  by  the  use  of  computers.  The  threshold  phenomenon 
in  phase-locked  loop  receivers  was  investigated  by  means  of  a  hybrid 
computer  simulation.  The  results  indicate  that  all,  properly  designed, 
demodulators  for  angle  modulated  systems  attain  the  same  improvement 
factor  above  threshold  and  that  the  major  difference  of  practical  importance 
is  the  location  of  the  threshold.  Factors  which  limit  threshold  extension 
in  the  reception  of  FM  and  the  implementation  of  improved  FM  demodulators 
employing  phase-locked  loop  structures  are  described. 


SUMMARY 


This  report  presents  the  results  of  investigations  which  were  under¬ 
taken  to  establish  the  maximum  performance  attainable  in  the  demodulation 
of  random  angle  modulated  (PM  and  FM)  signals  through  the  use  of  estima¬ 
tors  based  on  certain  statistical  criteria  of  optimization.  These  criteria 
are  the  minimization  of  the  mean-square  error  (MMSE),  and  the  maxi¬ 
mization  of  the  a  posteriori  probability  (MAP)  (i.  e.  estimation  of  the 
modulation  after  observation  of  the  noise  perturbed  signal). 

Because  angle  modulation  is  an  inherently  nonlinear  process  it  is 
difficult  to  obtain  useful  analytical  expressions  for  the  performance  of 
these  systems  which  are  valid  at  all  input  signal-to-noise  ratios  and  for  all 
values  of  the  modulation  index.  However,  by  a  combination  of  analytic 
and  computer  techniques  it  has  been  possible  to  cover  the  required  range 
of  operating  conditions.  Asymptotic  expansions  for  large  and  small  input 
signal-to-noise  ratios  (S/N)^  (ratio  of  the  carrier  power  to  noise  power  in 
the  bandwidth  of  the  modulation)  have  been  obtained  in  Chapter  II.  One  of 
these  expansions  applies  to  input  signal-to-noise  ratios  such  that,  operation 
extends  from  a  point  below  threshold  on  upward.  The  range  of  input 
signal-to-noise  ratios  and  modulation  indexes  of  most  practical  interest  is 
covered  by  this  result.  It  is  believed  that  this  constitutes  the  first  quanti¬ 
tatively  useful  analytic  derivation  of  the  limiting  performance  for  this 
region. 

Another  analysis  presented  in  Chapter  III  examined  the  problem  of 
minimum  mean-square  error  estimation  at  very  low  input  signal-to-noise 
ratios  and  obtained  an  asymptotic  expansion  valid  in  that  domain  for  all 
values  of  the  modulation  index.  For  small  values  of  modulation  index  an 
asymptotic  expression  valid  at  all  input  signal-to-noise  ratios  has  been 
obtained  in  Chapter  IV.  This  formula  bridges  the  gap  between  the  domains 
of  the  large  and  the  small  (S/N).  expansions  at  small  values  of  the  modu¬ 
lation  index  and  is  compatible  with  these  asymptotic  expansions. 

There  exists  a  region  of  intermediate  (S/N).  and  moderate  to  large 
modulation  indexes  which  could  not  be  treated  adequately  by  analytic  means. 
This  region  was  investigated  by  the  use  of  both  digital  and  analog  computers 
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(Chapters  IV  and  V).  The  digital  computer  investigation  yielded  upperbounds 
(i.  e.  theoretical  performance  cannot  be  better  than  that  computed)  on  tbe 
performance  attainable  for  all  values  of  (S/N).  and  moderate  values  of  the 
modulation  index  for  PM  modulation.  The  asymptotic  behavior  at  high  (S/N)'. 
was  found  to  be  in  agreement  with  the  analytic  expressions  of  Chapters  II  and 
IV.  A  large  range,  -10  to  +30  db,  of  the  intrinsic  input  signal-to-noise  ratio 
(S/N).  was  explored,  but  there  was  insufficient  computer  time  available  to 
explore  a  very  large  range  of  the  modulation  index.  However,  the  detailed 
computer  program  is  included  (Appendix  IV-A)  and  this  should  make  it  readily 
possible  for  the  reader  to  extend  the  range  of  parameters  investigated.  Large 
modulation  index  FM  systems,  ratio  of  RF  to  modulation  bandwidth  up  to  82 
were  investigated  by  the  use  of  a  hybrid  computer  (partly  digital  and  partly 
analog).  The  results  of  this  investigation,  which  was  aimed  primarily  at 
determining  the  threshold  performance  of  phase-locked  loop  (PLL)  FM 
receivers  are  reported  in  Chapter  V.  The  value  of  (S/N).  at  which  threshold 
occurs  was  determined  as  a  function  of  phase-locked  loop  design  and  the 
degree  of  modulation  employed.  By  use  of  the  hybrid  computer  it  was  readily 
possible  to  carry  out  simulation  of  a  zero  delay  phase-locked  loop  design 
suggested  by  the  integral  equation  which  describes  maximum  a  posteriori 
estimation.  The  resulting  threshold  performance  was  determined  rather 
accurately  and  it  was  found  that  by  empirical  modifications  to  the  loop  trans¬ 
fer  function,  the  threshold  characteristic  could  be  improved  further. 

It  is  noted  that  previous  PLL  analyses  based  on  a  linearized  model 
assume  that  the  threshold  occurs  when  the  mean- square  phase  error  pre¬ 
dicted  by  that  analysis  reaches  a  nominal  rms  value  of  the  order  of  0.  5 
radians.  Analysis  and  computer  investigations  show  that  it  is  possible  to 
reduce  the  value  of  (S/N).  at  which  threshold  occurs  below  that  predicted  by 
the  above  model.  While  this  conclusion  was  reached  without  postulating  any 
specific  demodulator  configurations  it  was  also  demonstrated  empirically 
that  the  threshold  of  a  phase-locked  loop  can  be  reduced  below  this  value. 
Some  recently  published  controversies  regarding,  for  example,  the  effect  of 
loop  bandwidth  and  modulation  on  threshold  performance,  have  been  resolved. 

Chapter  I  presents  a  discussion  and  comparison  of  the  results  of  all  of 
the  investigations  summarized  above.  Chapter  II-V  contain  the  analytical 
derivations  and  detailed  descriptions  of  the  computer  simulations. 
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EVALUATION 


This  study  was  undertaken  to  determine  the  limitations  of  frequency- 
modulation  receivers,  insofar  as  the  FM  threshold  is  concerned.  The 
contractor,  Cornell  Aeronautical  Laboratory,  was  successful  in  doing 
this  by  employing  a  variety  of  methods,  some  analytical  and  some 
involving  the  use  of  simulation  on  a  computer. 

This  Teport  presents  a  consistent  approach  to  the  study-  of  the 
threshold  phenomenon  in  E*i  demodulation.  For  the  first  time,  reasonable 
bounds  have  been  set  on  the  achievable  threshold,  determining  the  actual 
amount  of  improvement  which  can  be  expected  for  today’s  receivers. 

The  contractor  has  dealt  with  a  very  difficult  and  heretofore 
unsolved  analytical  problem.  Because  of  the  non-linearity  of  the 
equations  involved,  obtaining  solutions  was  an  extremely  difficult 
task.  The  fact  that  the  differing  methods  employed  to  achieve  a 
solution  lead  to  results  which  agree  with  each  other,  indicates  that 
they  are  correct. 

Once  this  amount  of  achievable  threshold  has  been  established  for 
a  particular  Air  Force  application,  it  remains  to  find  out  what  actual 
circuitry  will  provide  this  extension  of  capability,  and  the  costs 
involved. 
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I.  INTRODUCTION 

The  objective  of  the  investigations  repotted  here  is  to  develop  a 
thorough  understanding  of  the  benefits  which  can  be  achieved  in  the  demodu¬ 
lation  of  angle  modulated  (PM  and  FM)  signals,  through  the  use  of  estimators 
based  on  the  statistical  criteria  of  minimization  of  the  mean- square  error  or 
maximum  likelihood  estimation. 

With  angle  modulation  the  modulated  transmitted  signal  is  given  by 


er( t)  = 

—  E„  XLtrt.  (L?0t  + 


where 


R  e{  }  designates  the  real  part  of  the  expression  in  the  brackets. 

E„  the  carrier  amplitude. 

Co0  the  carrier  radian  frequency 

e[a(‘),t]  the  phase  angle  at  time  t  due  to  the  modulation  signal  a(>). 

The  reason  that  the  phase  angle  is  written  and  not  0{a(t)J 

that  with  certain  forms  of  modulation  the  value  of  9[}  *  -}  at  time  t  is 
determined  not  only  by  the  value  of  a(t)  at  time  T  =t ,  but  rather  by  the 
entire  function  «.(•).  For  example,  with  FM  6  ~/sf  +  60 . 

Since  in  general 


Re{e^?)}  *  Re{e*}.  Re  {e”} 


angle  modulation  is  inherently  a  nonlinear  operation  even  when 
is  a  linear  functional.  The  nonlinear  nature  of  the  modulation  is  directly 
responsible  for  such  salient  characteristics  of  angle  modulated  communi¬ 
cation,  systems  as  the  improvement  factor  (greater  noise  immunity 
obtainable  with  PM  or  FM  than,  with  a  linear  modulation  system,  e.  g. ,  AM), 
greater  bandwidth  occupancy  and  the  threshold  effect.  This  nonlinear 
characteristic  also  makes  the  analytical  treatment  of  these  systems  very 
difficult. 
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The  demand  for  more  communication  channels  has  in  recent  years  led 
to  a  progressive  narrowing  of  the  channel  bandwidth  assigned  to  FM  voice 
transmission  from  100  kHz  to  50  kHz  to  25  kHz.  In  part,  these  narrower 
assignments  have  been  made  possible  by  the  development  of  better  frequency 
control  systems j  however,  the  overriding  consideration  has  been  the  demand 
for  more  channels.  With  linear  modulation  systems  where  the  RF  bandwidth 
of  the  transmitted  signal  is  independent  of  the  degree  of  modulation,  the 
receiver  bandwidth  can  be  reduced  to  a  certain  point  without  impairment  of 
performance  as  better  frequency  control  of  the  transmitter  and  receiver 
becomes  possible.  This  reduced  receiver  bandwidth  may  actually  result  in 
improved  performance  because  of  the  decreased  amount  of  noise  accepted  by 
the  receiver.  With  double  sideband  AM,  and  a  4  kHz  audio  modulating  sig¬ 
nal  and  a  corresponding  8  kHz  required  RF  bandwidth,  assuming  precise 
tuning,  it  is  obvious  that  the  25  kHz  channel  spacing  is  not  dictated  by 
consideration  of  the  required  RF  bandwidth.  On  the  other  hand,  with  FM 
modulation  the  required  bandwidth  8  is  approximately  given  by  Carson's 
rule,  B  —Z[/t+s)yi  so  that  for  a  25  kHz  channel  spacing  and  modulation 
bandwidth  W  =  4  kHz,the  modulation  index  JL,  could  at  most  equal 

"  -BT-1  "  iS"1 

With  this  restriction  on  the  bandwidth  of  the  transmitted  signal,  the 
performance  may  be  degraded  noticeably  compared  to  that  obtainable  with 
wider  bandwidth  FM  systems.  As  is  well  known,  the  above-threshold  signal- 
to-noise  ratio  performance  in  a  random  noise  environment  will  vary  as  the 
square  of  the  modulation  index.  In  many  cases,  a  6  db  reduction  in  output 
signal-to-noise  ratio  may  be  tolerated  in  order  to  gain  a  two-fold  gain  in  the 
number  of  channels .  Even  with  a  modulation  index  as  low  as  2,  the  FM 
system  will  still  have  a  signal-to-noise  ratio  characteristic  superior  to  AM. 
However,  especially  in  vehicular  applications,  the  increased  susceptibility 
of  FM  systems  to  impulse  noise  as  the  bandwidth  is  reduced  may  be  a  far 


If  these  systems  are  modulated  beyond  their  normal  operating  range, 
overmodulated, nonlinear  operation  will  occur,  more  RF  bandwidth  will  be 
occupied  and  the  demodulated  signal  will  be  distorted. 
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more  important  factor  than  consideration  of  thermal  noise.  In  fact,  one  of 
the  major  reasons  why  FM  has  been  employed  in  the  mobile  service  is 
because  wideband  PM.  systems  have  been  iossd  to  be  less  susceptible  to 
imnulsive  type  interference  than  AM  systems.  However,  PM  systems 
lose  this  advantage  when  small  values  of  modulation  index  are  employed. 
Consider  an  PM  system  with  a  4  KHz  modulating  signal.  The  iestaataaeoas 
frequency  is 

Co  (t)  =  ^ 

and  the  resulting  phase  is 

?|t)  —  OSqT  *■  /fe  COf-t 

Cja 

—  Caat  +  jz  A#ii  £oat 

Thu st/£-  is  numerically  equal  to  the  transmitted  peak  phase  deviation  {in 
radians)  due  te  modulation.  For  very  large  values  of  JX  ,  the  peak  phase 
excursions  can  be  many  radians,  while  for  a  JX  cf  2,  the  peak  phase 
deviation  will  he  2  radians  or  approximately  114. 6  degrees.  An  interfering 
impulse  can  cause  at  most  a  3:  ISO  degree  phase  error  and  therefore  will 
affect  the  output  of  a  narrow-band  {low  Jt  )  system  much  more  than  a  wide¬ 
band  system  where  the  phase  perturbation  caused  by  the  impulse  will  be 
much  less  than  the  phase  variation  created  by  the  modulation. 

From,  the  outset  of  this  program  it  was  anticipated  that  it  would  be 
very  difficult  to  find  a  single  technique  capable  of  determining  the  limiting 
performance  of  angle  modulated  systems  over  the  desired  range  of  input 
signal-to-noise  ratio  and  modulation  index.  Therefore,  it  was  decided  to 
undertake  several  distinct  investigations,  each  of  which  is  most  effective  in 
a  restricted,  domain.  It  was  possible  to  choose  these  investigations  such 
that  the  overlap  of  these  domains  resulted  in  coverage  of  the  entire  desired 
range  of  parameters. 

By  analytic  means,  using  asymptotic  expansions,  it  was  possible  to 
cover  the  following  cases: 

1)  The  large  (S/N).  region,  for  all  values  of  the  modulation  index. 
The  results,  derived  in  Chapter  IE,  are  valid  from  large  (5/N)^  down  to 
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and  in  to  the  threshold  region  for  values  of  the  modulation  index  of  most 
interest. 

2)  The  small  (S/N).  region  for  all  values  of  the  modulation  index. 
These  results  are  derived  in  Chapter  Ht- 

3)  The  region  of  small  modulation  indexes  for  all  values  of  (S/N).. 
These  results  are  reported  in  Appendix  C  to  Chapter  IV. 

In  addition  to  these  analytic  efforts  the  following  investigations  were 
performed  with  the  aid  of  computers . 

A  digital  computer  was  used  to  obtain  bounds  on  the  performance 
attainable  with  PM  for  £3 /?£).  over  the  range  of  -15  to  -r-30  db  for  small  to 
moderate  values  c?£  the  modulation  index.  This  range  of  gj/Ji).  includes  the 
entire  threshold  region  where  it  is  very  difficult  to  obtain  results  by  analyti¬ 
cal  techniques.  This  investigation  is  described  in  Chapter  IV. 

A  hybrid  computer  (partly  analog  and  partly  digital)  was  used  to 
determine  the  performance  obtainable  by  realizable  demodulators,  the 
design  cf  which  is  suggested  by  application  of  statistical  optimization  criteria. 
The  threshold  behavior  cf  several  phase-locked  loop  designs  was  explored 
for  PM  systems  with  bandwidth  expansion  factors  as  large  as  82.  Chapter 
V  contains  a  detailed  description  of  these  investigations. 

The  modulation  signals  used  were  obtained  from  random  processes 
wife  statistics  chosen  by  considering  both  applications  and  facility  of  carry¬ 
ing  out  fee  investigations.  An  appropriate  statistical  description  of  fee 
modulation  process  if  of  course  a  prerequisite  to  the  application  of  statistical 
estimation  techniques.  Furthermore,  it  is  known  that  in  order  to  carry  any 
information,  in  the  technical  sense,  the  modulating  signals  must  be  generated 
by  random  processes.  For  the  purpose  of  analysis  it  is  convenient  to  assume 
that  the  modulating  signal  is  a  sample  function  generated  by  a  random 


,  ~Tbe  intrinsic  input  signal-io-noise  ratio  {S/N).  is  defined  as  fee  ratio 
of  RF  signal  power  to  RF  noise  power  in  the  bandwidth  of  fee  modulation 

(S/N).  =  —  jffcr  w^ere  Her  -  *  •  carrier  amplitude 

Ut  .  .  .  noise  power  density 

.  .  bandwidth  of  modulation 


W  * 


Gaussian  process.  There  exists  considerable  evidence  that  results  obtained 
by  analysis  using  Gaussian  modulation,  or  by  testing  with  Gaussian  noise 
loading-  can  be  used  to  predict  the  performance  obtained  with  other  types  of 
modulation,  such  as  speech  or  data.  It  is  also  noted  that  in  certain  appli¬ 
cations  of  great  practical  importance,  e.g. ,  in  frequency  division  multiplex 
systems,  where  many  independent  modulation  signals  are  multiplexed,  the 
statistics  of  the  resulting  modulation  approach  that  of  a  Gaussian  process. 

In  the  analytical  treatment  reported  in  Chapters  II  and  HE,  random 
Gaussian  modulation  was  used.  For  the  computer  investigation,  reported  in 
Chapter  IV,  a  uniformly  distributed  modulation  process  was  used.  The 
reason  for  this  choice  was  chat  the  uniform  distribution,  in  contrast  to  the 
Gaussian  distribution,  does  not  have ‘’tails'1.  The  absence  of  tails  of  the 
uniform  distribution  results  in  a  more  economical  computer  investigation. 

In  the  hybrid  computer  simulation,  both  filtered  Gaussian  noise  and 
sinusoidal  modulating  signals  were  used.  The  latter  were  used  primarily 
for  comparison  with  results  obtained  with  tests  using  the  traditional  sinus¬ 
oidal  test  tones.  However,  by  this  means  it  was  also  verified  that  the 
results  obtained  with  Gaussian  modulation  can,  with  caution,  be  used  to 
predict  the  performance  obtained  when  other  modulating  signals  (e.g., 
sinusoids)  are  employed.  For  example,  the  threshold  observed  with  a 
phase-locked  loop,  PI/L,  occurs  at  a  value  of  (S/N)^  which  depends  on  the 
degree  of  modulation  present;  however,  when  the  rms  frequency  deviation 
was  kept  constant,  the  threshold  occurred  at  the  same  value  of  (S/N)^  with 
both  Gaussian  aid  sinusoidal  modulating  signals.  (This  observation  was  made 
at  a  relatively  large  value  of  the  modulation  index  and  may  not  hold  for  small 
values  of  the  index,  although  it  is  obviously  applicable  in  the  limit  as  the 
index  approaches  zero. ) 

In  this  report  we  are  concerned  with  determining  the  performance 
attainable  with  angle  modulated  signals  when  certain  criteria  of  statistical 
estimation  are  utilized  to  determine  the  receiver  output.  The  performance 
of  a  communication  system  is  ultimately  judged  in  terms  of  satisfying  a  user. 
Because  the  feedback  of  user’s  reaction  is  a  slow  process  which  often  yields 
only  qualitative  or  grossly  quantized  information  (e.  g. ,  the  system  is  or  is 
not  satisfactory),  it  is  necessary  to  develop  more  quantitative  measures  of 
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the  performance  of  communication  systems.  In  the  case  of  digital  systems 

the  probability  of  error  is  usually  used  as  the  criterion  while  with  analog 

systems  the  output  signal-to-noise  ratio  (S/N)  is  often  used.  In  many 

o 

applications  it  is  possible  to  relate  the  output  signal -to -noise  ratio  to  the 
probability  of  error  when  digital  data  are  sent  over  the  communication  system. 
This  should  not  be  construed  to  imply  that  the  output  signal-to-noise  ratio 
suffices  to  specify  the  performance  of  a  communication  system.  As  a  matter 
of  fact,  in  order  for  specification  of  (S/N)q  to  be  of  much  use,  most  of  the 
other  parameters  of  the  system,  such  as  bandwidth,  noise,  and  signal 
spectra,  etc.  ,  must  be  known.  However,  for  a  given  system  these  para¬ 
meters  may  be  either  fixed  or  their  dependence  on  (S/N)q  may  be  known. 

Under  these  conditions  knowledge  of  (S/N)d  is  useful  in  determining  system 
performance.  Although  the  concept  of  output  signal-to-noise  ratio  is  widely 
used,  it  is  essential  that  it  be  precisely  defined  in  order  that  it  may  reason¬ 
ably  be~used  as  a  quantitative  measure  of  the  performance  of  a  communication 
system. 


In  a  linear  system,  such  as  sketched  above,  the  output  signal-to-noise 

ratio  can  be  defined  as  (S/N)  =  °y  power  due  to  signal  input  d 

o  output  power  due  to  noise  input 

(S/N)q  can  be  maximized  by  an  appropriate  choice  of  the  filter  transfer 
function  H(O)-  Unless  the  signal  and  noise  spectra  are  identical  one  finds 
in  this  case  that  maximization  of  the  output  signal-to-noise  ratio  leads  to  a 
very  narrow  band  filter  which  passes  just  that  band  of  frequencies  where  the 
ratio  of  the  signal  spectral  density  S(Co)  to  the  noise  spectral  density  A !((*>) 
is  greatest.  In  most  cases  the  output  of  such  a  system  would  be  useless  for 
the  intended  transmission  of  information.  Consequently,  a  system  specifi¬ 
cation  must  always  require  that  some  other  criterion  in  addition  to  output 
signal-tornoise  ratio,  as  defined  above,  be  met.  Very  often  this  is  stated 
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in  terms  of  the  required  frequency  response,  e.  g. ,  the  response  shall  be 
flat  within  some  tolerance  over  a  certain  band  of  frequencies. 


Assuming  that  the  system  has  been  specified  so  as  to  be  satisfactory 
in  the  absence  of  noise,  one  is  certainly  interested  in  the  manner  in  which 
its  performance  degrades  as  noise  is  added  to  the  receiver  input.  If  the 
system  is  linear  it  now  makes  sense  to  consider  the  output  signal-to-noise 
ratio  as  a  measure  of  this  degradation.  In  this  case  the  output  signal-to- 
noise  ratio  is  simply  the  output  power  due  to  the  signal  input  divided  by 
output  due  to  the  noise  input. 

Most  communication  systems  exhibit  a  quasi  linear  range  where  the 
total  output  can  be  considered  as  consisting  of  the  sum  of  the  output  due  to 
signal  plus  the  output  due  to  noise.  If  one  wishes  to  measure  the  output 
signal-to-noise  ratio  in  this  region  one  must  supply  an  input  signal  which  is 
sufficiently  strong  so  that  operation  is  above  threshold.  While  it  makes 
sense  to  define  the  output  signal-to-noise  ratio  as  the  output  power  due  to 
the  signal  divided  by  the  output  power  due  to  noise,  one  certainly  cannot 
measure  the  output  power  due  to  the  noise  by  removing  the  input  signal.  If 
this  were  done  the  system  would  drop  below  threshold  and  invalidate  the 
measurement.  In  some  cases,  a  way  out  of  this  difficulty  is  to  remove  the 
modulation  while  maintaining  the  carrier.  A  safer  technique  is  to  measure 
the  correlation  between  the  modulation  and  the  noisy  receiver  output.  One 
now  assumes  that  the  system  acts  in  a  quasi  linear  fashion.  In  other  words, 
it  is  assumed  that  while  the  noise  level  is  influenced  by  the  strength  of  the 
carrier  that  the  output  noise  is  independent  of  the  modulation. 


The  correlation  coefficient  J°(i)  between  input  and  output  <Z(t ) 
is  defined  by 

'  \e£(t)  ctflti]**. 


(2) 


<  a  (£)&<?)> 


ri 
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where  the  angular  brackets  denote  statistical  average  of  the  quantity  within 
the  brackets  and  are  the  variances  of  OL(t),  &(£)  .  Iia-(t)  and 

cL(£)  are  stationary  processes,  then  the  correlation  coefficient  is  inde¬ 
pendent  of  tim e\p(t)  =  .  Unless  otherwise  stated  we  shall  assume  that 

&■(£)  are  stationary  and  ergodic.  The  latter  assumption  permits 
time  averages  to  be  substituted  for  ensemble  averages^,  as  was  done  in 
the  experimental  work  reported  in  Chapter  V.  We  note  that  the  correlation 
coefficient  remains  unchanged  in  the  presence  of  linear  amplification-  The 
relationship  between  correlation  coefficient. and  signal-to-noise  ratio  is 
easily  established  for  independent  additive  noise  with 


<CLCt)>  =<&(£)>  =  o  ,  <a.(t)n(t)y  = 0  . 


-  <*(t)  &(t)f  _ 

J  o£(xzcg+0%) 

Gg(kZC&+Cf*) 


xz<?Z 


(s/rio  = 


k2o£ 


.  p\ 

S-Pz 


(3) 


.For  stationary  processes  it  is  always  possible  to  experimentally 

evaluate  the  correlation  coefficient  between  the  modulation  and  its  estimate 

•  '  p* 

at  the  output  of  any  system,  linear  or  otherwise.  The  quantity  A.0  -  f 

which  reduces  to  the  output  signal-to-noise  ratio  for  the  case  where  only 

noise  is  added  to  the  .signal  is  used  as  a  measure  of  system  performance  in 

parts  of  Chapters  ILE  and  W- . 

-  .  .  \  » 

..  It  is  not  difficult  to  show  (via  Appendix  C  of  Chapter  IV)  that 

Ji0  =  provided  that  the  level  of  the  output  is  adjusted  to  minimise 

-((d.  -  &  =  /iS£  which  would  of  course  be  the  case,  with  minimum  mean-  ! 


square  error  estimation.  The  relationship  of  Jl#  vs 
Figure  I--1. 


is  shown  in 
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In  all  of  the  investigations  reported  in  this  report  we  have  assumed 
that  the  received  signal  is  perturbed  by  additive  white  Gaussian  noise  of 
spectral  power  density  Ng  watts /Hz  over  the  RF  bandwidth  8  of  the 
receiver.  Many  of  our  results  are  reported  in  terms  of  the  intrinsic  input 

>52 

signai-to-noise  ratio  (S/N).  = 


where 


4-  - 


carrier  amplitude,  volts 


.  .  .  noise  spectral  density  watts /Hz. 

V/ .  .  -  bandwidth  of  the  modulation,  Hz. 

Both  8  and  W  are  one-sided  bandwidihs  (positive  frequencies  only) 
and  Mo  is  a  one-sided  power  spectral  density.  The  noise  in  the  RF  band¬ 
width  is  then  0/%  and  the  signa!-»to -noise  ratio  in  the  RF  bandwidth  is 


2/vo0 


where  //=— is  the  bandwidth  expansion  factor. 

As  the  RF  input  *  ignal-to-noise  ratio  (S/N).  becomes  very  large,  the 
minimum  MSE  goes  to  zero  and  Af  /Pjfjr  '~'J  pftjT  This  is  confirmed  by 
the  experimental  data  presented  in  Chapter  IV  where  plots  of  yia  and 
vs  (S/N).  with  all  quantities  expressed  in  db,  have  the  same  asymptote  at 
large  (S/N).. 

As  the  RF  input  s ignal-to-noise  ratio  approaches  zero  the  output  of  the 
receiver  becomes  independent  of  the  modulation  of  the  RF  input  signal. 

Under  these  conditions  the  minimum  mean-square  error  in  estimating  the 
modulation  approaches  the  pov/er  of  the  modulation,  MMSE  ^  O 'a.  •  Conse- 
quently.  Si#  -  — goes  to  zero  as  (S/N)..  approaches  zero.  This  is  also 


confirmed  by  the  results  of  Chapters  III  and  IV  where 

~ 00 <&  as  ^S/N^  — — ^  *J  * 


&S  awd 


The  observation  that  the  MMSE  a/  as  the  inout  signal-to-noise 

ratio  goes  tu  zero  implies  that  when  the  input  signal-to-noise  ratio  is  very 
small  the  best  estimate,  in  the  mean-square  error  sense,  goes  to  zero. 
This  observation  should  not  be  too  startling.  .As  a  matter  of  fact,  very 


similar  approaches  have  been  in  practical  use  for  many  years,  e.  g. ,  noise 
limiter  circuits  which  reduce  the  output  of  a.  receiver  to  zero  when  the  input 
noise  is  So  large  that  a  usable  output  signal  cannot  be  obtained  and  squelch 
circuits  which  disable  the  receiver  unless  a  sufficiently  strong  carrier  is 
received. 


A  major  objective  of  this  contract  is  to  evaluate  the  performance- 
actaiaable  through  the  use  of  the  criterion  of  minimum  mean-square  error 
estimation;  in  this  case  use  the  ratio  of 

modulation-ppwe^  =  =  for  <*>--<?  ,  which  is  often  proposed 

mean-square  error  /4S£  /rfS£  K 

as  an  alternate  definition  of  output  signal-to-noise  ratio,  is  particularly 
appropriate  as  a  measure  of  performance. 

However,  the  quantity  also  plays  a  fundamental  role  in  inform- 

ation  theory  where  it  is  closely  related  to  the  rate-distortion  function.  ’  ’  -* 
Shannon  has  shown  that  in  order  to  transmit  an  analog  signal  through  a 
communication  channel  with  a  given  mean-square  error  between  output  and 
input,  a  minimum  information  rate  /?  >)f  /fcj/J  must  be  provided.  (This 

notation  indicates  that  the  information  rate  F£*t  '1  is  a  function  of  both  the 
modulation  process  CL(')  and  the  permissible  mean-square  error,  MSE). 
For  the  case  where  &.(•)  is  a  white  Gaussian  process  limited  to  bandwidth 
W  Hz 


/?£>(•), /w] 


bits 

sec 


(5) 


It  is  emphasized  that  equation  {£)  does  not  apply  to  other  than  white  Gaussian 
processes.  However,  the  relationship 

£ 

WJe?*.  tUt  '  <6> 

$  ■ 

where  Ff (cl)  is  the  entropy  power  of  d(,)) holds,  for  any  source  limited  to 
bandwidth  W  Hz.  For  white  Gaussianly  distributed  d(-) ,  Ff(o.)  - 
so  that  (S)  applies, 

^  * 

The  entropy  power  of  a  random  process  is  defined  as  the  power  of  a 

white  Gaussian  process  having  the  same  bandwidth  and  entropy  as  the  process 

under  consideration,  [l] 
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In  order  to  transmit  information  at  the  rate  /?\Q-0)}  MS£ J  the  channel 
capacity,  C,  must  be  equal  to  or  greater  than  this  rate.  In  general  it  is  not 
known  how  to  transmit  a(.)  over  a  given  channel  sO  as  to  obtain  a  desired 
MSE  when  that  channel  has  the  minimum  required  capcity  C  =  jjaY*),  A/SJT^  . 

However,  in  any  communication  system  with  given  channel  conditions 
a  certain  MSE  will  result  and  this  MSE  can  usually  be  decreased  by  improving 
the  channel  conditions.  This  will,  however,  require  a  channel  of  capacity 
greater  than  /?  .  The  difference  between  the  actual  capacity  and 

the  minimum  required  capacity,  or  the  actual  (S/N)^  and  the  minimum 
theoretically  required  (S/N)^  are  indications  of  how  efficiently  the  channel 
is  being  utilized.  This  difference  is  in  general  attributable  to  several  causes: 

The  modulation  (coding)  used  may  not  be  optimum  for  use  with  the 
available  channel.  For  example,  with  angle  modulation  the  spectrum  of  the 
transmitted  signal  does  not  in  general  fill  the  channel  uniformly;  this  can  be 
interpreted  as  a  manifestation  of  suboptimal  coding.  The  demodulation 
(decoding)  used  may  not  be  optimum;  the  optimum  demodulation  process  is 
unknown  for  arbitrary  forms  of  modulation  processes. 

In  the  investigations  reported  here  the  modulation  was  constrained  to 

r 

be  angle  modulation  (PM  or  FM)  and  it  was  attempted  to  determine  the  opti¬ 
mum  performance  attainable  under  this  constraint  with  the  intent  of  compar¬ 
ing  the  performance  actually  attained  by  known  techniques  for  the  demodu¬ 
lation  of  these  signals  against  the  optimum..  Our  investigations  show  that  if 
the  modulation  index  is  held  constant  and  the  channel  capacity  is  varied  by 
changing  the  input  signal-to-noise  ratio  (S/N).,  the  available  channel  capacity 
is  used  most  efficiently  when  operation  is  near  or  somewhat  below  the 
threshold  region.  From  a  practical  point  of  view  this  is  a  very  difficult 
region  in  which  to  operate  because  small  changes  in  (S/N).  result  in  large 
changes  in  output  signal-to-noise  ratio.  If  (S/N).  is  increased,  so  that 

Oaf  ^ 

operation  ia  above  threshold,  the  ratio  '/j$£  obtained  increases,  but  at  a 
lesser  rate  than  theoretically  made  possible  by  the  increase  in  channel 
capacity.  As  a  matter  of  fact,  with. angle  modulation  above  threshold 
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increases 


increases  at  most  linearly  with  (S/N).  whereas  the  limiting 

,  M  1 

as  (S/N)*; 

Where  M  is  the  bandwidth  expansion  factor 


MSE 


M  =  W&L  = 
W 


RF  channel  bandwidth _ 

Bandwidth  of  the  modulation 


(7) 


It  is  taerefore  not  "efficient”  to  operate  such  systems  far  above 
threshold.  In  order  to  obtain  efficient  operation  without  being  unduly 
sensitive  to  fluctuations  in  (S/N).,  the  modulation  index  should  be  adjusted 
such  that  operation  is  not  too  far  above  the  threshold  region.  This  may,  of 
course,  not  be  practical,  for  instance  when  the  available  (S/N).  is  large  the 
modulation  index  would  have  t.o  be  increased  to  a  value  which  would  result  in 
a  transmitted  spectrum  which  exceeds  the  assigned  RF  bandwidth.  Efficient 
utilization  of  the  transmitted  power  under  the3e  conditions  could,  however, 
be  maintained  by  increasing  the  modulation  bandwidth. 

The  capacity  of  a  channel  perturbed  by  additive  Gaussian  noise  is 
given  by  the  famous  formula^ 

c  *  &  ( '  y  ",r3/*'c-  (8> 

which  takes  the  limiting  form 


Jsim  C 


(9) 


*  <jcL 

The  rate  of  increase  of  753^  vs  (S/N).  expressed  in  db  above 
threshold  depends  upon  che  spectrum  S&.0 u)  &f  the  modulation.  A  unity  slope 
is  obtained  for  a  strictly  bandlimifced  spectrum,  while  a  first  order  Butter- 
worth  spectrum  resuHs  in  a  slope  of  .  25  and  a  third  order  Butterworth 
spectrum  in  a  slope  of  approximately  0.  6.  These  results  are  due  to  a 
widening  of  the  frequency  response  of  the  receiver  as  (S/N).  increases  so  as 
to  minimize  the  total  IvlSE  consisting  of  a  distortion  and  a  noise  component. 

If  the  receiver  response  is  kept  fixed,  then  the  output  noise  component  above 
threshold  always  decreases  1  db  for  each  db  of  increase  in  (S/N).  [4]. 
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Assuming  that  the  modulation  process  is  white  Gaussian  with  bandwidth  y/ 
and  combining  Equations  (5)  -  (9),  one  obtains 


Mr  =  [/ *  (i0) 

^&3Ti  „  ('s/s/); 

AfS£  ~  (1J) 


as  bounds  on  the  performance  attainable  with  any  combination  of  modulation 

and  receiver.  These  expressions  are  plotted  in  Figure  1-2  together  with 

.2 

experimentally  derived  bounds  on  ^ox  PM  derived  in  Chapter  IV.  The 

interpretation  of  these  bounds  is  that  no  communication  system  <~an  exceed 
the  performance  (plot  above  the  solid  curves)  described  by  equations  (10),  (11), 
and  that  a  PM  system  cannot  exceed  the  performance  depicted  by  the  dashed 
curves.  The  experimental  curves  were  obtained  by  use  of  a  digital  computer, 
as  explained  in  detail  in  Chapter  IV.  In  that  chapter  It  is  pointed  out  that 
there  is  some  difficulty  in  defining  the  SF  bandwidth  for  randomly  angle 
modulated  signals.  Bandwidth  expansion  factors  of  10  and  20  are  considered 
to  be  "generous"  for  the  values  of  J3  =  4  and  8,  used  in  the  curves  shown. 

It  will  be  observed  from  Figure  1-2  that  a  change  by  even  a  factor  of  2  in  the 
value  of  Af  shifts  the  value  of  (S/N)^  at  the  level  of  corresponding  to 

the  threshold  by  only  a  very  small  amount.  It  is  clear  that  the  PM  bounds 
closely  parallel  the  general  bounds  derived  from  information  theory  below 
threshold,  but  deviate  rapidly  above  threshold. 

For  (S/N)^  such  that  operation  is  at  least  a  few  db  above  threshold, 
the  performance  of  angle  modulated  systems  can  be  easily  computed  by 
linear  analysis  (viz  Appendix  C  of  Chapter  IV).  Furthermore,  it  is  found 
that  linear  optimization  techniques  employed  above  threshold  lead  to  the 
same  performance  for  all  demodulators,  e.g.,  the  above  threshold  perform¬ 
ance  of  a  properly  designed  receiver  using  a  discriminator  will  be  the  same 
as  thaifor  a  phase-locked  loop.  However,  different  demodulation  techniques 
can  result  in  drastically  different  values  of  the  (S/N).  at  which  threshold 
occurs .  The  normal  operating  range  for  angle  modulated  systems  is 
restricted  to  above  threshold  operation,  in  fact,  for  the  comparions  of 
various  demodulators  the  value  of  (S/N)-  required  for  above  threshold 
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operation  is  often  considered  to  be  the  parameter  of  greatest  practical 
importance-  The  mice  of  (S/N).  required  for  above  threshold  operation  will 
be  a  function  of  (1)  the  type  of  receiver,  (2)  the  degree  of  modulation,  and 
(3)  the  spectrum,  of  the  modulation. 

The  value  of  p/fi).  required  for  above  threshold  operation  always 
increases  with  increasing  modulation  index  (increasing  RF  bandwidth).  In 
the  older  systems,  using  limiters  and  discriminators,  occurrence  of  the 
threshold  is  determined  primarily  by  the  signal- to-noise  ratio  in  fee  RF 
bandwidth.  Consequently,  in  these  systems  the  minimum  intrinsic  signal  - 
to-noise  ratio  (S/X).  required  for  above  threshold  operation  has  to  increase 
approximately  linearly  with  increasing  bandwidth  expansion  factor-  Wife 

r$| 

more  recent  designs  using  frequency  modulation  wife  feedback'  (FMFB)  , 
or  phase-locked  loops,  ^  (?LL),  fee  intrinsic  signal -to-aedse  ratio  (S /!•<)_, 
increases  less  rapidly  wife  increasing  RF  bandwidth. 

The  minimum  valce  at  which  threshold  can  occur  can  be  determined  as 


follows.  Consider  for 


j,  FM. 


The  transmitted  5M  signal  is  given  by 


er(£}-/±  co*-(coa£f/2j  a.(u)du) 


The  instantaneous  radian  frequency  deviation  is  then  JS  aft)  rad/sec. 
With  sinusoidal  modulation  a(t)  =  sin  ZTTy/t  so  that  , 

and  the  modulation  index  jjl  =  -  =  zTTy/  ~ 

It  has  been  found  feat  for  this  case  negligible  distortion  occurs  if  an 
RF  bandwidth  given,  by  Carson’s  rule 


-  2/vn  (/*■+/)  -  Z  ( A/jnax  +f/n) 


is  used.  Certainly,  the  amount  of  distortion  due  to  use  of  an  RF  bandwidth 
limited  to  this  value,  is  negligible  compared  to  the  output  noise  when  opera¬ 
tion  is  near  threshold.  If  the  receiver  has  a  flat  response  from  0-W  Ha  the 
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output  signal -to -nois e  ratio  above  threshold  is  found  to  be 


(14) 


If  the  signal  distortion  component  is  negligible  we  can  equate 


(S/N)  ,  to 

1  'out  ms£  • 

Now  consider  a  Gaussian  random  modulation  function  having  a  flat 

spectrum  over  the  band  0~W  Hz  and  operating  with  the  same  value  of  y3  •  In 

order  to  minimize  the  MSE  the  receiver  must  have  a  flat  response  over  the 

f  8l 

band  0~Y/  Hz  when  the  input  signal-to-noise  ratio  is  sufficiently  large. '  J 
With  a  fixed  receiver  operating  above  threshold  the  output  noise  is  independ¬ 
ent  of  the  modulation,  provided  that  the  RF  bandwidth  B  is  sufficiently 
large.  Therefore,  in  order  to  obtain  the  same  output  signal-to-noise  ratio 
for  a  given  (S/N).  the  same  modulating  power  must  be  used,  e.  g. ,  the 

“  <*■£•  1° the  case  of  sine  wave 
modulation  the  peak  radian  frequency  deviation  was  J3  and  the  modulation 
frequency  was  Y/  ,  For  the  case  of  Gaussian  random  modulation  it  is  not 
possible  to  uniquely  specify  either  a  peak  frequency  deviation  or  a  modulation 
frequency.  Nevertheless,  a  bandwidth  adequate  for  any  specified  distortion 
can  be  found.  In  order  to  make  the  results  obtained  directly  comparable  with 
the  sinusoidal  case  it  would  be  desirable  to  define  the  peak  deviation  as 
Bi 2*  Oq,  -  J3  and  the  modulation  frequency  as  y/  .  The  probability  that 
this  "peak  deviation"  is  exceeded  is  approximately  .  16,  the  modulation 

frequency  is  clearly  conservative  since  the  modulating  spectrum  is  limited 

W 

to  O-W  Hz,  e.g. ,  the  average  frequency  is  -g-  Hz.  It  therefore  appears 
reasonable  to  use  the  sinusoidal  definition  of  bandwidth  for  the  purpose  of 
computing  the  bounds  on  the  minimum  (S/N).  required  for  above  threshold 
performance.  (It  will  turn  out  that  the  results  obtained  are  not  strongly 
dependent  on  the  definition  of  bandwidth  used. ) 

In  Figure  1-3  the  information  theory  bounds,  Equations  (10),  (11),  and 
the  above  threshold  FM  performance,  Equation  (14),  are  plotted.  It  is  seen 
that  for  sufficiently  small  (S/N).  the  linear  analysis  predicts  values  of 
greater  than  permitted  by  information  theory.  This  means  that  the  linear 
analysis  is  hot  applicable  in  this  region. 
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Figure  1-3  INFORMATION  THEORY  BOUNDS  ON  PERFORMANCE  AND 
ABOVE  THRESHOLD  FM  PERFORMANCE 


o 


:  f 


Threshold  may  be  defined  as  the  point  below  which  the  performance 
deviates  by  some  appreciable  amount  from  that  predicted  by  the  linear 
analysis.  We  therefore  conclude  that  threshold  must  occur  at  higher  values 
of  (S/N).  than  given  by  the  intersection  of  the  corresponding  (same  value 
of  //  )  straight  and  curved  lines  shown  in  Figure  1-3.  The  values  of  (S/N). 
at  the  intersections  can  be  used  to  obtain  a  bound  on  the  attainable  threshold 
with  FM  versus  bandwidth  expansion  factor.  The  curve  obtained  in  this 
manner  is  shown  as  curve  A  of  Figure  1-4,  which  illustrates  the  dependence 
of  the  value  of  (S/N)..  at  threshold  on  bandwidth  expansion  factor  for  various 
FM  demodulation  systems,  as  well  as  the  bounds  derived  by  application  of 
information  theory.  For  /V  >  /O  the  slope  of  curve  A  is  less  than  1  db 
per  octave.  Therefore,  the  bounding  value  of  (S/N).  at  threshold  is  not 
critically  dependent  on  the  value  of  bandwidth  expansion  factor  used. 

f9l 

Curve  B  is  a  plot  of  results  obtained  by  H.  AkimaL  ,  who  considered 
a  system  where  the  modulation  signal  is  sampled  and  "boxcarred"  at  the 
Nyquist  rate  of  2W  times  per  second.  The  demodulator  consists  of  a  bank  of 
contiguous  filters  each  2 W  Hz  wide,  each  followed  by  an  amplitude  detector 
and  a  conventional  limiter  discriminator.  A  "greatest  of"  circuit  compares 
the  outputs  of  the  amplitude  detectors  and  selects  the  filter  which  is  assumed 
to  contain  the  signal.  The  output  of  the  corresponding  discriminator  is 
added  to  the  center  frequency  of  the  selected  filter  to  form  the  estimate  of 
the  frequency  of  the  transmitted  signal.  Akima's  work  assumed  sinusoidal 
modulation  at  frequency  W.  From  Figure  1-4  it  is  observed  that  Akima's 
curve  closely  parallels  curve  A.  This  implies  that  asymptotically  with  large 
M  frequency  modulation  uses  bandwidth  efficiently.  The  absolute  differ¬ 
ence  between  curves  A  and  B  is  ascribed  to: 

1)  Curve  A  is  a  lower  bound  for  FM,  i.  e. ,  it  is  only  known  that 
FM  threshold  cannot  occur  below  this  curve. 

2)  Curve  B  uses  only  realtime  processing  up  to  the  output  of  the 
discriminators.  A  comparable  restriction  does  not  apply  to 
curve  A. 

3)  It  has  not  been  proven  that  the  curve  derived  from  Akima's 
results  represents  the  limiting  performance  obtainable  with  FM. 
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,  -  H  BMDWIDTH  EXPAKStOM  FACTOR 

Figure  1-4  COMPARISON  OF  FH  DEMODULATOR  THRESHOLD  PERFORMANCE 


Curves  C  and  D  represent  the  threshold  performance  of  realizable 
FM  receivers  operated  with  sinusoidal  modulation.  Curve  D  was  obtained 
from  Skinner *s  wgrJ*  it  applies  to  the  use  of  a  conventional  discriminator. 
In  this  case  the  threshold  occurs  at  a  slowly  increasing  signal-to-noise  ratio 
as  measured  iiithe  RFb  and  width-. 

This  is  iUustrated  in  the  table  below: 


(S/N!rf  =  (S/NJ. 


M  : 

5 

10 

40 

.  -• 

M-db 

7 

10 

16 

(S/N).  db 

15. 7 

20;  6 

28.8 

'  <S/N)RI.db 

8.7 

10. 6 

12.8 

Curve  G  represents  results  obtained  from  the  simulation  of  realizable 
phase-locked  loops,  as  described  in  detail  in  Chapter  V.  The  results  show  that 
a  significant  threshold  improvement,  with  respect  to  a  discriminator,  can 
be  achieved  with  conventional  PLL  systems  for  the  values  of  modulation 
index  normally  encountered.  In  the  PLL  systems,  the  threshold  appears  to 
occur  when  the  rms  value  of  the  loop  phase  error  reaches  approximately 
0.  5  radians.  It  might  be  noted  that  this  value  of  phase  error  at  threshold 
was  obtained  in  the  PLL  simulation  and  also  observed  as  the  filtered  phase 
error  at  threshold  in  the  Monte  Carlo  simulation  of  the  bounds  on  the  MMSE 
and  MAP  estimation  in  a  PM  system.  The  (S/N).  at  which  the  threshold 
occurs  will  be  determined  by  the  design  of  the  particular  system.  In  the  case 
of  a  PLL,  the  threshold  occurs  at  a  more  nearly  constant  signal-to~noise 
ratio  (approximately  6-7  db)  as  measured  in  the  RF  bandwidth,  than  is  the 
case  with  a  discriminator.  This  can  be  deduced  from  Figure  1-4  where  the 
slope  of  curve  C  is  seen  to  be  intermediate  between  the  slopes  of  curves  A 
(or  B)  andlX  As  far  as  the  design  of  phase-locked  loops  is  concerned  it 
must  be  emphasized  that  the  analytic  work  on  maximum  a  posteriori 
estimation  leads  to  phase -locked  loops  which  contain  unrealizable  components. 
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It  turns  out  that  the  transfer  functions  of  the  loop  filter  specified  by  this 
analysis  are  identical  -with  those  which  one  obtains  if  one  replaces  the 
sinusoidal  nonlinearity  with  a  linear  gain  and  performs  the  usual  infinite 
delay  Wiener  filter  design.  A  physically  realizable  phase-locked  loop  must, 
however.,  utilize  realizable,  zero  delay  components.  It  has  often  been  sug¬ 
gested  that  the  optimum  PLL  design  is  obtainable  by  use  of  the  realizable, 
zero  delay  Wiener  filters.  As  long  as  the  PLL.  operates  in  an  essentially 
linear  manner,  i.  e. ,  above  threshold,  optimum  performance  is  obtainable 
in  this  manner,  provided  the  appropriate  compensating  filter  is  used  at  the 
Output  of  the  PLL.  However,  we  do  not  know  of  any  evidence  which  guaran¬ 
tees  that  this  procedure  will  lead  to  the  best  performance  in  the  threshold 
region.  On  the  contrary,  we  have  found,  that  by  empirically  changing  the 
loop  gain  and  filter  transfer  function  from  those  specified  by  the  above  design 

pr  ocedure,  somewhat  improved  performance  can  be  obtained  in  the  threshold 
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region.  It  has  been  reported1-  *  ’  J  that  replacing  the  conventional 

phase  defector,  which  produces  the  sinsuoidal  nonlinearity  called  for  by  the 
theory  of'MAP  estimation,  in  a  phase-locked  loop,  with  some  other  type  of 
phase  detector,  can  re, suit  in  improved  PLL  performance,  e.  g. ,  threshold 
extension. 

A  significant  improvement  in  the  demodulation  of  angle  modulated 
signals  may  be  possible  if  the  application  does  not  require  realtime  proces¬ 
sing.  The  operation  specified  by  the  infinite  delay  MAP  analysis  could  be 
closely  approximated  if  the  received  signal  plus  noise  were  available  in 
stored  form,  as  for  example  by  recording  the  I.  F.  signal.  Demodulation 
might  require  computer  processing  and  would  entail  some  delay,  at  least  of 
the  order  of  the  correlation  time  of  the  modulation,  before  the  estimate  of 
the  modulation  would  become  available.  In  many  applications  the  delay 
could  be  so  small  that  these  systems  would  be  entirely  practical  for  situations 
where  "realtime"  demodulators  are  ordinarily  thought  to  be  a  necessity. 

In  Chapter  II  the  problem  of  performing  the  minimum  mean-square 
error  estimation  of  the  modulation  of  a  randomly  angle  modulated  signal  is 
treated  analytically.  Because  of  the  nonlinear  modulation  process  this  is  a 
difficult  problem  and  several  assumptions,  the  validity  of  which  requires 
further  justification,  had  to  be  made  in  order  to  be  able  to  carry  the  analysis 
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through  *o  completion.  The  results  obtained  for  iLc  PM  esse  v?zv£  ased  to 
compute  the  curves  of  Figure  1-5.  In  Figure  1-6  the  results  obtained  by  the 
computer  simulation  reported  in  Chapter  IV,  normalized  to  the  same  scale 
as  Figure  1-5,  are  shewn  superposed  on  these  analytical  results.  (It  is 
worthy  to  note  that  these  curves  are  scaled  directly  from  Figure  IV- 1,  which 
was  drawn  before  the  analytic  results  were  available. )  These  curves  differ 
primarily  in  the  difference  of  (S/N).  at  threshold.  The  important  point  is 
that  the  results  of  Chapter  IV  are  performance  bounds  which  cannot  be 
exceeded,  whereas  the  results  of  Chapter  II  are  due  to  specific  steps  which 
should  be  implementable  in  practice.  From  the  discussion  of  the  limits 
imposed  by  information  theory  it  is  known  that  the  threshold  must  move 
toward  higher  (S /N).  as  increases  consequently,  the  analytically 

obtained  results  would  for  very  large  J2>  ultimately  be  untenable.  It  is 
believed  that  this  inconsistency  is  due  to  one  of  the  above  mentioned 
a.  s  sumptions. 


Chapter  HI  develops  an  analytic  evaluation  of  the  performance  obtained 
by  angle  modulated  systems  utilizing  minimum  mean-square  error  ^estimation 
and  operating  under  conditions  of  very  low  (5/N)^.  Using  Aa  -  as  the 

criterion  of  performance  asymptotic  expressions  for  Aa  in  terms  of  (S/N)j[ 
and  the  modulation  index  are  derived.  JLq  is  found  to  vary  linearly  with 


(S/N).  when  (S/N).  «  /  for  all  modulation  spectra  SQ  (w)  ,  The  asymptotic 
results  indicate  that  the  severity  of  the  threshold  defined  as  the  ratio  of  the 


large  (S/N).  asymptote  to  the  small  (S/N)^  asymptote  increases  exponentially 
with  the  square  of  the  modulation  index,  viz  Figure  1-7. 


The  major  portion  of  the  difference  in  the  performance  indicated  by  the 
analytic  results,  including  the  digital  computer  simulation  and  those  obtained 
in  practice,  or  by  the  analog  computer  simulation,  is  attributed  to  the  use  of 
so-called  nonrealizable  data  processing.  This  means  in  practice  that  the 
estimate  of  the  modulation  0.(f )  at  time  Z*  could  not  become  available 
until  sometime  thereafter,  that  is  at  time  t-  Z'-f'A  .  It  is  important  to 
realize  that  the  amount  of  delay,  A.  >  required  in  order  tc  obtain  essentially 
all  of  the  improvement  which  can  be  obtained  with  infinite  delay  is  of  the 
order  of  the  correlation  time  of  the  modulation.  For  most  applications  the 
irreducible  delay  would  be  of  little  consequence. 


The  intensive  efforts  made  by  many  investigators  over  the  past  several 
years  notwithstanding,  there  is  no  evidence  that  the  limiting  performance  of 
angle  modulated  systems  has  been  attained,  and  we  anticipate  that  significant 
improvements  in  performance  will  be  achieved  in  the  future. 

Recommendations 

1)  The  major  portion  of  the  difference  in  the  performance  theoretically 
attainable  as  derived  by  analysis  and  digital  computer  simulation  and  those 
currently  attained  in  practice  is  attributed  to  the  use  of  so-called  nonrealiz- 
able  data  processing  (i.  e. ,  not  realisable  without  delay).  Analysis  shows 
*hat  MAP  and  MMSE  estimation  using  nonrealtime  estimation  gives  essentially 
similar  results.  A  technology  to  implement  these  estimators  should  be 
developed.  Implementation  would  require  fee  use  of  storage  and  computers. 

2)  The  configuration  of  the  realisable  (zero  delay)  receiver  for  angle 
modulated  signals  which  gives  optimum  performance  in  the  threshold  region 
is  unknown.  Efforts  aimed  at  development  of  improved  receivers  should  be 
continued. 

3)  The  investigations  reported  here  were  concerned  with  a  situation 
where  the  only  disturbance  is  additive  white  Gaussian  noise.  Real  channels 
are  often  subject  to  fading,  which  results  in  severe  amplitude  and  phase  fluc¬ 
tuations.  The  analysis  of  such  situations  is  very  difficult  and  use  of  channel 
simulators  or  experimental  investigations  have  sot  proven  entirely  satisfactory. 
The  use  of  computer  simulation  techniques  for  these  investigations  is 
recommended. 

4)  In  order  to  carry  the  analysis  reported  in  Chapter  II  through  to 
completion  it  was  necessary  to  make  a  number  of  assumptions,  which  have 
not  been  fully  justified.  The  results  obtained  predict  a  performance  which 
asymptotically  with  large  modulation  index,  exceeds  bounds  derivable  from 
information  theory.  This  inconsistency  should  be  resolved  and  the  required 
rigor  introduced  into  the  analysis. 

5)  The  digital  computer  investigation  reported  in  Chapter  IV  has  been 
constrained  by  economic  considerations  to  a  rather  limited  range  of  the 
modulation  index  J3  and  use  of  only  uniform  distribution  of  the  amplitude 

of  the  modulation.  For  better  comparison  with  the  analytic  results,  this 
investigation  should  be  expanded  to  include  a  wider  range  of  J3  and 
Gaussianly  distributed  modulation  processes. 
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n.  MINIMUM  MEAN  SQUARE  ERROR  ESTIMATION  OF  RANDOM 
ANGLE  MODULATED  SIGNALS; 

WITH  EMPHASIS  ON  THE  THRESHOLD  REGION 

1.  Summary 

A  phase  modulated  signal  of  the  form 

eR  ft)  =  Eo  +/3a{t))+  nit),  (1)* 

is  considered. 

We  study  the  problem  of  determining  the  MMSE  (minimum  mean- 
square  error)  estimator  of  the  modulating  signal  a(i)  given  the  received 
signal  in  the  presence  of  bandlimited  additive  Gaussian  noise  n(t). 

The  method  used  consists  of  the  following  steps: 

1)  Eliminate  the  carrier  a)0  by  considering  the  in-phase  and 

quadrature  components  et  and  where 

ej(t)  -  Ee  ax.  +  nl(t) 

e^t)  =  E0  +  nz(t)  (3) 

In  writing  these  expressions  we  have  assumed  that  the  carrier 
phase  is  known  and  we  have  assumed  that  the  distortion  due  to  a  limited  RF 
bandwidth  6  is  negligible.  (This  point  is  considered  in  more  detail  in 
Appendix  A. ) 

2)  Convert  the  continuous  time  variable  to  a  discrete  set  of  time 
samples  by  letting  t  =  t0  +  Kd  }  K  =>  0, 1,—  H  where  A  =  -g-  .  The  MMSE 
estimate  is  now  given  by  the  conditional  expectation  of  the  modulation 

It  can  be  determined  by  evaluating  the  derivative  of  the  conditional  charac¬ 
teristic  function  t(icS)  at  the  origin,  tft>  **  0. 

3)  Set  up  an  integral  representing  the  characteristic  function 
of  the  conditional  probability  density  of  the  modul_ang  signal  having  the 
value  a(t)  given  the  received  signal  £%(t) 

JA 

^Equation  numbers  in  this  summary  correspond  to  the  numbers  of 
equations  developed  later  in  this  Chapter. 
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where  the  modulating  signal  a(v)  is  assumed  to  be  a  Gaussian  random  vector 
with  zero  mean  and  covariance  matrix  R  and  am  is  the  value  of  tnA. 

(The  covariance  matrix  K  is  related  to  the  autocorrelation  function  Ra  (t) 
by  the  relation  )•)  The  evaluation  of  the  integral  (Equation  (15)) 

is  the  crucial  step  in  this  analysis.  If  the  integral  could  be  analytically 
evaluated  the  problem  of  determining  the  MMSE  estimate  could  be  con¬ 
sidered  to  be  completely  solved  from  a  theoretical  point  of  view. 

4)  Approximately  evaluate  this  integral  for  f(ic b) 

a)  By  a  power  series  method  for  low  signal-to-noise  ratios. 

b)  By  an  asymptotic  method  for  large  signal-to-noise  ratios. 

5)  Determine  the  desired  MMSE  estimate  by  evaluating  the  log¬ 
arithmic  derivative  of  the  characteristic  function  at  the  origin  and  determine 
the  associated  conditional  minimum  mean-square  error  by  evaluating  the 
second  derivative  of  the  logarithm  of  the  characteristic  function.  (Use  of 
the  logarithmic  derivatives  eliminates  the  need  to  evaluate  the  normalizing 
constant  in  Equation  (15).) 

6)  Because  of  the  nonlinear  nature  of  the  modulation  the  conditional 

minimum  mean-square  error,  determined  in  step  5  is  a  func  ion  of  the 

received  signal  6g(t)  .  The  final  step  is  to  determine  the  minimum  mean- 
square  error  by  averaging  the  conditional  minimum  mean-square  error 
over  eg(t).  (The  conditional  minimum  mean-square  error  would  be  inde¬ 
pendent  of  the  received  signal  with  linear  modulation  when  both  the  noise 
and  the  modulating  signal  are  Gaussian  processes. ) 


The  results  of  this  analysis  are: 


For  small  signal-to-noise  ratios  ^ 
power  in  bandwidth  B  ,  we  have 


ios  (kJ 


<<  /,  where  CC2  is  the  RF  noise 


S.  =  Hkl  (*)  ♦«(£)’ 

f  -  CfeW  v  ofe? 


In  the  case  of  bandlimited  white  modulation  and  an  infinite  observation 
interval  we  have  for  the  expected  value  of  the  error 


A5S  E 


-i  -AW,  yr  e'73’0*} 


where 


§4)1;  = 


Wi  2/v0v/ 

For  large  signal-to-noise  ratios: 

-  ««-*  A.  H  +  cfo) 
«SE=  Pl  fc||P|| 


iLo—0 


3C 

diCo 


Uo=*o 


where  CL  is  the  solution  of  the  equation 


/fx  f*£-  =0 

^  L  0  J 


(29) 


(61) 

(62) 


(63) 


and  P  is  the  matrix 

P  s  +  /5*jT~  xsw(/3X-fl^,  where  is  a  diagonal  matrix. 


We  conjecture  that  the  terms  C(o)  and  are  negligible  for  large 
signal-to-noise  ratios  and  for  moderate  signal-to-noise  ratios  when  the 
observation  time  is  long.  This  has  not  been  rigorously  demonstrated  and 
requires  further  study. 

AS 

We  may  note  that  the  first  term  may  be  shown  to  be  the  equivalent 
to  the  output  of  an  unrealizable  phase-locked  loop  (i.  e. ,  a  PLL  which 
includes  nonrealizable  filters). 


For  the  case  of  a  flat  signal  spectrum  we  obtain  the  following 
approximation  to  the  expected  value  of  the  mean-square  error 
OE*  _  (S/M)i  <Y> 


where 


/3lMSE  1  +(j><Y>  + 

<V>  ”l-#/3aMSE 

This  result  is  plotted  in  Figure  XI— 1 . 


/3 
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As  discussed  in  Chapter  I,  it  is  ^nown  that  this  result  becomes  incom¬ 
patible  with  bounds  derived  by  JShannon^  for  /S  —co.  It  is  believed  that 
this  conflict  is  due  to  the  approximations  which  were  made  in  evaluating  the 
expected  value  of  the  mean-square  errdr.  ' 


Figure  H-!  RESULTS  OF  ANALYTIC 
OF  PM  DEMODULATION 
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OF  MMSE  PERFORMANCE 


2.  Development  of  Minimum  Mean-Square  Error  Estimate 
Consider  the  received  waveforms 

eR(t)  “  eT(t)+n[t)  =  E0  +/3aft|+  n(t)  (1) 

where  f,(t)  is  an  additive  noise 
EB  is  carrier  amplitude 
6)0  is  carrier  frequency- 
aft)  is  the  modulating  sign?U 
is  the  index  of  modulation 
t  is  the.  time 
eR(t)  is  the  received  signal. 


Expressing  eR(t)  in  terms  of  its  in  phase  and  quadrature  components: 

eR(t)  ~  et(t)  /Coe.  Co0t  -  e2(t)  Aim  Co0t  (2) 


where 


e1(t)  =  E0  /Coe/3a(t)  +  rJx(i) 
fiz(t)  -  E0  Mm/3a(t)  +  w2(t) 


(3) 


Instead  of  dealing  with  the  continuous  input,  take  a  set  of  equally  spaced 
samples  at  times  ~f0  +  hA,  b  «  I,  2,  •••,  ^ 


Let 

ei  ft*  *  ej*  = 

ez(t0+hA)  =  eafe  =  B0^»fiAk+nth  (4) 

o 

Thus  we  reduce  the  problem  to  a  finite  dimensional  vector  problem 

Let  ei  be  the  vector  with  components  Glk 
e2.  be  the  vector  with  components  etk 
3  be  the  vector  with  components  afe 
ft.  be  the  vector  with  components  v.. 

(5) 

n2  be  the  vector  with  components  H2k 
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Given  the  joint  probability  of  the  additive  noise  and  the  transmitted 
signal  <JP  —f(a,nlyr.^  da  dn2  ;(  since  a,nlyti2  vectors  (6) 

da  “  da1da1  •••  daw>  etc. 

we  may  make  a  change  of  variable  from  r3  to  e  yielding 


dP  =  $ (a»  ei~Eo  ‘Cemfia. ,  e2  -£-0  Atofia)  da  c/e*  de£ 


(7) 


Now  let  us  make  the  following  assumptions: 

The  signal  3  and  the  noise  components  nt,n2  are  independent; 

The  noise  is  bandlimited  white  Gaussian  with  zero  mean  and 
mean-square  value  6~nz  =  BN0 

The  noise  spectrum  is  symmetrical  about  fo0  and  the  time 
interval  A  is  selected  such  that  £>A  —  1, 
where  6  is  the  RF  bandwidth  in  Hz. 


Then 


f (a , n,  ,i7*}  -  f(a)  f{n ,)  f{n2) 


and 


where 


Thus 


f(".)  - 

■PN  - 


1  e-«- 


arc.* 


{**<?, ff* 


e 


n.*n,  =  12  n2b 

k-i 


(8) 


-jir.  /aM/3s)-(e,-£a  xurt/Sa) 

dP  =  -^(a)  (prjrQ-iy  e  dade/dex  (9) 

If  we  integrate  equation  (9)  over  3  we  get  the  differential  probability 
of  the  received  signal  (  e;,  e*  ).  The  conditional  probability  of  a  signal  vector 
given  the  received  signal  would  be 


(10) 
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We  know  that  the  conditional  expectation  of  3.  f 'C)  a  component  of  a. 
will  be  the  minimum  mean-square  error  estimate  of  the  modulation  at  time 
The  problem  i3  to  find  this  value  and  to  compute  the  mean-square  error. 

The  difficulty  in  the  computation  is  caused  by  the  sinusoidal  nonlinearity  in 
equation  (9).  We  are  going  to  attempt  to  approximate  this  result  by  consider¬ 
ing  an  approximation  to  the  conditional  characteristic  function  of  2.^.. 

Let  d  Pa  **  d 

The  characteristic  function  (ilo)  is 

=  J  J Pa  e  (11) 

(  %  corresponds  to  one  of  the  sampled  times,  i.  e. ,  T  ^t^+hA 
for  some  h  in  the  range  considered. ) 

Now  consider  the  function  ln$(iCS)  and  note  that 


a(?)  *“  ~  'yfi)  condition  expectation  of  a(t)  given 


s2  =  = 

Assume  the  modulation  a  is  Gaussian  with  zero  mean  and 
covariance  matrix  Ra 


e:,e2(12) 


Thus 


f®  - , 


1 


2*/^  a  « 


(**)*IM* 

where  il^aS  js  the  determinant  of  the  matrix  ft. 


(13) 


For  convenience  we  make  a  change  to  polar  coordinates 
eik  =  r.k  ™9k 
thtk  "  rk  ^ek 

deide2  ^/idnde 

Combining  equations  (9)»  (11).  (13),  and  (14),  we  get: 

(,/A  „ i  fj ,  •R£la. 

H)  Ja 


(14) 


(15) 


jJ(cCo)  „ 


(15) 

con't. 


where  K  is  a  constant  with  respect  to  a  which  may  be  ignored  since 
we  only  need  the  logarithmic  derivatives  of 

So  far  only  the  approximations  that  have  been  made  are  the  conversion 
of  the  continuous  data  to  a  discrete  set  and  we  have  ignored  the  distortion 
effects  due  to  bandlimiting.  (See  Appendix  U-A  for  a  discussion  of  the  effects 
of  bandlimiting. ) 


Small  Signal -to -Noise  Ratios 


As 

and  get 


may  expand  /i-,c*4.fj3a -&)*j  in  a  power 


—  K J*dd  l* 


e 


This  integral  is  evaluated  by  use  of  the  identity*- 
e  <*a-e’  >  yielding: 


.  «  /sA*  r  r  /  f 

+rUif) 

J  *1  kc)  *■ 

+  e  '■(-%*%)  -/**)•  *a  (l»r  +ft +ft) 

***)  +fi k) 

+  e 

+  e  <  (  'A  (16) 

*  o(#)‘  ••• 


Where  the  notation  Co^  is  used  for  a  vector  with  zero  components  in 
all  positions  except  for  the  T™  whtre  it  has  the  value  Co  .  Similarly,  for 
/ 3 ^  and  G^s  is  the  element  on  the  diagonal  of  Ra  (mean-square  value  of 

signal  &  ). 


tt 

*4 


The  derivative  of  Equation  (16)  is 


ay 

3lco 


-  *  Jv  r-* 

=  Ki  e 


-•£  (&f  +A)*K«(£*r  */%)+ 

ur  *  Ra  (i^oT  ♦  i/Si)  6 

»\~  rJ7i_  _i 

)  t  *  2 

„  B  ,.  ...  -4(tor*4H«  ( Lot, 

+  U-f  *  Ra(i&t*  v%)  e 

^  ^  i 

♦  («ir-«.(faMH^ 

*  0(cf-/  (17) 

where  is  used  to  denote  a  unit  vector  with  a  one  in  the  T  position. 
The  second  derivative  evaluated  at'  iCo  =  0  is 


a’y 


difc1 


I  =  Kt  fc‘  -  (f fiT  e'W 

iCo  =*0  *•  * 

*  *&r 


(18) 


•» 

-s? 


% 

J 


*5 


3f 
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'2* 


°{°)  ~  Ki  j1  +  l*f)  ~  n*  ^  6k e 


io  ~  ^1  f  (j^j  £.  SlfiR*(M)e 

i 3 _ «  Vi 


I  iW  =0 


/M4  ^  £  dlL2L%fiut-/tafc+/%e**^ 

Wf»  /  Eo  L 

+ iUrR4ft.fr)  e  i(-3^J/^-^)  *  **65,  -.^) 

-  it ir-Rafa-fr)  *  Ra^'-A) 

- i Ur'R»(/3j+/3k)  e if-B'+edJ/tto +A)1 


For  very  small 


(t-r 


£/.*]=_!_  .m§. 

w  yfo)  di& 


we  have 


ilo  m  0 


£i  -  Tifw^  -($]&.,  “  e  </s 

rt  /  Q\  -)£/3aei* 

Since  nk  <x*  dk  =  £c  <u^/3ak  +  nlk  and  \n*  ^  **/  =  eoe 

The  expected  value  of  /Yfl  may  be  computed  as 
MSE  =  {£*)  -  <4*  -  e  ^  ^  +  •  •  »  (23) 

Replacing  the  sum  by  an  integral  we  get  for  a  final  result 

MSE -or -4s-  e  dtuNr-t)*---  (24) 


*0? 


2. 

T-  e  J  dt  R*(r-t) *••• 


(25) 


For  a  flat  lowpass  signal  spectrum,  of  width 


WHz  and  intensity  A 


Rq(t)  Ra(0) 


jintZif  wr 

ZirWT 


<Ta  =  Ra(o)  =  WAe 


and  if  t0  =  -  00  ,  *  00 


J  dir  RaCt- 1 )  =  %  =  *aZ. 


/ 


—  CO 


<r  =  s/v6 


:  *  —  /r  i 


SA  =  1 


Thus,  MSE  =  (Tfl 


where 


(S/n)[  —  2-v»  w* 

*  f  .  _  a*LL  it 

1  [ '  z  No  * 


e-a 


36  =  1 


(26) 


(27) 


substituting 

Comparison  of  Equation  (27)  with  Equation  (22)  of  Chapter  III,  shows 
agreement  upon  use  of  the  relationship  between  K0  and  derived 

in  Appendix  C  of  Chapter  IV . 


Including  terms  of  J  we  'n: 


£  £a  .1 


tt/3 


I*  'C#JL9k  Ra(KA) 


+Aui6jMH,ek  -%Mt/+(*arf  +mp~/3 


Taking  the  expected  value  yields 


-  (f)  -  <r„2-  c'^l  Ufa) 


/t " ^V“'  Ll  (/fl  '**  - e^i'X Hat  *  R„Uy  i e,t.  mi) 

k  J  L  ■ 

♦(«-*  V.  cfi' V)(  *4.  *  *>>  *  i„t.  m) 


These  may  be  approximated  by  integrals. 


Note 


^  4y  Gy  *vt*  c^QtZ)  =  ~t~  e'6  ^,x  ^k)  +Gn  Sjk 

(a:  Aut  6i  a  ;  am,  Gf\  =•  H~  C*(t  ^/*)+<51*4 


.Integral  Approximation. 


[M 4(r-t) 


Ut0 


(28) 


^  -zM  rf:  rl 


r4Az<S*  6 


£&  "Co  L, 


„  2  jusn  zTrWV  z 

If  we  let  R^.-  cfa  ~27ry/f  >  &'a  =  ?  IT  do  Wc 

t0--°°  >  £jf  =  +  00 


Assume pz CJ^Z  >  /  >  second  term  predominates. 


Approximately  we  have 


/45£  _  z  2  ,  .  .  -/3"g'a 

cT~  ~  7 -£<**( s/")l  *  - 


,2  2 


2  2. 


where  ( S/tf)i  - 


s; 


2KW 


(29) 


2  2 


For  very  3mall  ^3  G^  «  1 


S7Sf 

C'a 


"  ~  *-/?<&  (s/*)i  +  £p+oi(s/N)i 


(30) 


Large  Signal-to-Noise  Ratio 

Returning  to  Equation  (15) 


(15) 
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The  integral  is  of  the  form 

Z  =  fdaem)  ,  where  a.  is  a  vector  and  F(&)  is  a  scalar  function,  thus 

-4 


z-p*,rLz._rj&/, 

J.tx>  J-  OO  J-oo 


Expand  f  ( d)  in  a  Taylor  series 


A  (a.)  =  Z(a)  *■(*-*)  'f (a- a)- /”' (*)(*-!)  + 


or  in  multidimensional  form 


/V*>,  =  F(a})aZ)  —a„)  +£ (*k\)  a£  + ^  (afh)(.ai-di)~Zi Tai 

K  A 


Select  2fj  to  be  the  value  of  which  make 


a/7  _ 


Then  for  a  first  approximation 


z  ~fda  e 

=(zTrf‘  em)/, /-//Z“a)ll 


where  ||  ||  designates  the  determinant  of  the  matrix. 


Correction  terms  are  obtained  by  using  more  terms  in  the  Taylor  series. 
— 

The  technique  we  are  using  is  a  multidimensional  form  of  the  prin¬ 
ciple  of  Steepest  Descent  or  Stationary  Phase  which  is  used  to  evaluate 
asymptotic  forms. 
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+iizz-zz(  ) 


T  ~  /v„  ^ P(a)  +  k(a -2) ‘f"{a)(a- a)  /_  ,  ~  w_  ~  w  ~  ,  a3/ 

Z~JJa*  [t + 3, ZZZ( aj -3j)( ak-ak )(arai) 

+?!'ZZ'Z:'Z  (zj-  Sj)  (aJt-2k)(zi-%)(a^3M)  + - -)  (35) 


<i*£j4*L  „  Sfon2M*-~V'rq)C*-i)tesTs;  ?w, 
yniwr  Jr  \rrr~  c^jwh) 


(aX'H)(*»f*m)  3a.  33i  ga/  33m  ) 


(36) 


(The  odd  moments  are  zero  because  of  symmetry) 
Now 


/V<?;  =  Lu>a(£)  t  c*i(/3a'0)-  4  <2  ‘Rg7  a 

ld[d)  ~  i“>skn  §4-  uk- R/' * 


(37) 

(38) 


y^/f  c* 

where  is  a  unit  vector  in  the  k  position  and  o ^  unless  k 
corresponds  to  Z~  when  SkJr- / 

dljftj-  =  -  0  #  -«i  ■  Ki'«t 


r  & 


(39) 


eV 


r“  ri  ff 

-  -Jr-  -J- '*im’(Par0k)£kJLm  -0}(4*/ffss 


(40 


•2  -4  - 


<**&**•*)£»/*.  =0,«,kss  i-Utn.n 

odk  °  °J>  a  am  aan  Ao  ^41 J 

-Thus,  about  the  point  2 


z  z 

P(t)  =  PGl)  +  4  (J-3)  ■  (-*?-  ~T-{jr-**03i-ej})(i-*1 
+3!  £(**-**)  TT*  +  4/  Z  (**-**)  J7f  + - 


(42) 


where  a  diagonal  matrix  with  elements  )  ' 

on  the  diagonal. 

Define  the  matrix  P  as 


/’=  *?*  0-{x  **(&-*?$ 


(43) 


Note  the  point  2  is  defined  by  the  matrix  equation 

xl'  *<■§&  *  <w, 


if 


(44) 


wherejj^^W/sJ-^Jis  a  vector  with  components- 
We  have 


+  -- 
eUa 


-  ^  ^ ft* 


ai£  + 


} 


(45) 


where  we  have  used 


fda  €  ^  (&-d)  'P(i-ti)  _  L0L  (if  Z7  is  positive  definite)  (46) 

JA  YiTp>i^  > 


4.5 


Also  we  have  jdd  (a^f  from  symmetry 

ld  (*•-*•)  ‘  V7TWTT  Ti  :  where  \t  <47> 


Z//P/I 


Thus 


/  7^ 

is  the  K  eigenvalue  of  P. 


X(cu})  a 


k/^_ Wf 
y  iip  a 


Af  r-Z„4 


t  *£;  <  <v  +— -J 


ffrco)  -/n  f{a)-'/E  Jtn  HPH  +  A  +2.  y  S  ^(pay#,)  N 

(  «  o;*  f  4  A,  7 


J  „  ,.  t  ,„,~s  Mm  -2-  £JL*>  '*4***CP2trO*)  dau 

d/i(o>)  _  XJn(tw)  _dffa)  1  s}  J  *!  &r  4  —  ^  + 


3£o>  3  ^‘W  2  II  PH 


The  MMSE  estimate  is  thus  given  by 


1+4  &0*  4r  Z*&±&3%z£*1  ■ 

*■  O?  T  *  A* 


^  =  ai 


1 4  6/ =  0 


c<V)  -■  f'  fL.  ±  A~KM  JEl 

/  +  %:,  r£@l  y~  6°*{pik-et)  Y  _ 


/ 


Thus 


6m (tv)  _  J_P  _  I,  dJnllPH  . 

^ .■  ,.i  “  \  ■ ...  ^  .  r 


d  c  uj  <)  i'cy 


d  i  co 


cO) 


M  -  jfC,  -4  A  urn  +  »£M 

"iw  ^£oy  ^  coo 
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Since  at  3=2- 

f  (a)  =  LCog  (t)  (/Sa -s)-4  a  •  Ra  a 

W  >  **“-  ^  -  #  Z  f  ^  *rt)«r  -?•»,-& 

and  :since 

*  W[t*‘('3i-4  =  C“S‘‘r  ' 

£f£sy.  =  dS-M 

d  i(o*  -  3  tto 

The  MMSE  estimate  is  then  given  by 

* "  s£L. = c(o> 

ana  the  mean-square  error  by 


MSE  =  jjs...  ■  =  -  9'afo) 

where  a  (r)  is  the  solution  of 


dLCox-\  dl(a  I  %  di to* 

hu>  -0  h(o  m  o 


dC 


di(o 

L(i)—0 


iCo  Or o 


3  +  O'/"  jj£'6*n(/3j-0)J  ~  0  for  the  element  corresponding 

the  T'  time  position 


to 


and  since 


a  a  = 
dico 


=  F6 


kx 


~3C0}~  ~1>[P  )vr  >  t^le  diagonal,  element  corresponding  to 

the-  x  time  position 


(55) 

(56) 


(57) 

(58) , 

(59) 

(60) 


(61) 


(62) 


(63) 

(64) 

(65) 


4-7 


Consideration  of  '-Correction  .Term 


Consider  c{Co)  as  defined  by  equation  (52) 
The  denominator  is  „ 

,  _2_  4 

P  ~  1  4-.!  £J^a  "  F, 


but  (see  Appendix  C) 


\  /^  (/3afc-0k)  =  Afc  ‘C#i(/3ak-fy  -A* ^»(/3ak-e^ 


(Eo  +Kk)  S&i/2(ak-at)  -  ^A^n/3(ak-2^ 


if  we  assume  ^/3(ak  '-a^  <<  1  we  have  approximately 
nk  c^/3(ak-dk)  ~  E0  +  n*'  _ 


with  an,  expected  value  of  E0 


Therefore 


<*> 


3  .g//3*  y  J_  . 

^  •  _  4  /  •*  •  <  *  • 


r  a/ 


Consider  the  matrix  P 

With  a  similar  approximation  to  the  one  above 


<P> 


3  '  <rn* 


Appr  oximately 


f 

mn 


Jj<* 


90  i:U)L(mr  n),  (pfco) 

e  .  — 


oc 


where;  is  the  Fourier  transform  of  the  correlation  Rg. 


and 


<€  -  *£&  -'“nb^s 


The  21  tt-  will  be  the  trace  of  (f)  1  ■ 

i  n  '  ' 


hence 


*  .  H  '  r 

£  j~f  =  2L 

i  n  »;  i 


1 

*> V 


A  27r  [l+i#rm 


(74) 


(75) 


The  term  N  4  represents  the  observation  interval.  Thus  as 
NA.  —t  oo  ,  (2>)  — ♦‘do 

The  numerator  is 


dJCo 


71 

(*)  “  “ 


3 

*1 A 

v  r 

n/,  ^m(/3ak-dk)  dBk  ,  , 

_  .  4- 

3 

s:A5 

r 

^  M/idu-a^tinffaurOk) 

aai, 

s; - u~  — 

4  <r* 

e0-H 

0iCj 

3 

El) 3  s 

r . 

ilk 

4 

'^z 

£0H 

dlCo 

(76) 

behaves 

as  the  mean-square  error 

I/9&- 

ak)|  << 

i 

3 

E^5 

L 

(77) 

'  "4 

£.o  A.  if 

..  3 

elAs 

T 

^(a^-a,,)^  ir^)  +  (nlk  t^} 

(78) 

'  4 

z. 
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we  conjecture  that  this  term  is  small  compared  to  the  denominator. 


N  A  —*■  co  . 


This  argument  is  not  intended  to  be  rigorous  but  only  serves  to 
suggest  the  plausibility  of  neglecting  C'(C o'). 


Evaluation  of  Logarithmic  Derivatives 


Consider 


l  .  a  IIP II  _  jr  sl’pH  d*k 

IPS  diCo  M\dak  di(p 


(79) 

(80) 


but  we  have 


where  pfck  is- a  principal  minor  of  p 


Thus  the  correction  to  the  .MMSE.  estimator  is 


jl  d Mi  l  P-  _  _ 
*  d i Co 


eMI 

?  ( T 


z 

k 


-I 


Fkk 


pn 


For  the  contribution  to  the  error  we  get- 


To  summarize  we  have  shown  that  the  MMSE  estimate 


a  =  B-x.-T  afe4*H'+  c(°) 

and  the  conditional  MMSE 


(81) 


(82) 


(83) 


(84) 


where  d ^  is  the  solution  of 


C (0 )  and  are  assumed  to  be  negligible  (this  point  requires 

further  investigation). 

Note  that  <fa  is  a  function  of  the  particular  received  signal  since  P 
is  a  function  of  3  .  Hence  we  shall'  attempt  to  evaluate  the  expected  value 
of  to  obtain  a  measure  of  the  performance  of  an  MMSE  estimator. 

In  evaluating  the  integral  in  Equation  (46)  it  was  necessary  to  assume 
that  the  matrix  [p]  is  positive  definite.  Since  [p]  is  a  stochastic  matrix 
the  validity  of  the  results  for  the  average  of  £z  to  be  obtained,  requires 
that  probability  of  [P]  not  being  positive  definite,  contributes  negligible 
error  to  the  evaluation  of  the  MMSE. 


Approximation  to  Obtain  Numerical  Results 


Consider,  the  matrix 


P  =  +  (89) 

=  RaJ  + 


*  Q 
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i 

i  - 

wnere  z 

T'1  -  r;1  *  (90) 

Q  =  pt  (91) 

'  *  ❖  '  .  _, 

Under  certain  restrictions  the  inverse  matrix  P  may  be  obtained 

from  the  expansion 

P_i  =  T  -  TQT  +  TQTQT -  -  (92) 

Thus  (since  ^Q)=0) 

(P'1)  =  T  +  T(QTa)T  +  ••••  (93) 


Let  us  make  the  further  simplifying  assumption  that  the  diagonal 
matrix  Wfl  XUrii(/3a-6jj\  is  a  constant  times  the  identity  matrix  I. 


Thus 


t'1  -crn*l4. 


e„/32 


where  (x)  =  (Xm)  = 

For  very  large  signal-to-noise  ratios  ~  1 


(94) 

(95) 


An  element  of  T  may  now  be  approximated  by 


T  *  — 

1  mn  £7T 


i 

'  dco  e 

J-6o 


iO>A'(m-n) 


<e  (co) 


ACTn 


r<x)^N 


(96) 


Where  {Co)  is  the  power  density  spectrum  of  the  modulating  signal. 
Thus,  the  dominant  term  in  the  error  is 


f)„- 


Trr  + 


i_r~  r(to) 

71  j  if  AM 

<J-co  An- 1 


(97) 


'Expansion  will -be  valid  when  the  norm  of  QT*  is  less  than 


one. 
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For  a  constant  (p'((a )  ' 

<?(Co)  =  4—  ,  H<  ZTtW 
<?(iy)  =  0  r  M^  ZTtM/  ' 

<?fo)  . 


(98) 

(99) 


in 


r<xW 


l  +  z 


where  C~a7'  —  WAC  the  mean -square  value  of  the 


and  Z  ~ 


where  (§4i\  = 


£}/3zAo. 

iNo 


modulating  signal 


_  •  _§£_  a  ,  ^  _££_ 
icrna  zNew  \ 


Consider  the  term 


cr  -  (  T.araT)ft. 


T  /.  ft,,  Qnj  P  03 


(100) 

(101) 


(102) 


Since  Q  is  diagonal 

J"  =  2!L  ~^ftn  v(?mm 

Let 


where 


/^mn 

Approximating  by  integrals 


(103) 

(104) 

(105) 


•  x^fEil3z\z  v  C,  C,  t \x>A(x~rny i u3A(m-n)*i u3A(n-<t) 

w  ^  /(Zrt)y°UljrU2JC*U3  e  f(“i)  f(ui)  f(u3)  (106) 


Js  .  ,  .v, 

Appendix.B  describes,  the  relationship  between  integrals  and  the 
corresponding  sums.  - 
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where  f(u)  =  ^ 


If  we  further  assume 


Mtnn  =  0 


171  ¥=  71 


^wn  Az.  m  11 


t  y  _l_l  rj  r.  r, 

^  (air)*  J  duij^uiJduJ  e  f(u,i  -f(u2)  f(«3)^z 
^  (If) •'"*  &(dcSiaLf  ‘w)(»  fdu‘ f M 


For  constant  ^  (£o) 


/  Az 

l  <S*  /  ~  " 

^  r^C-a2- 

X  ♦  Z  L  (i  +Z)J 


Az  g~/  £q  g? 
A  1*Z  (i+z)x 

/pcrjz  yUt  Eg  1 


£Z±.  0  ( 

<*>  <E*J 


Thus  the  evaluation  of  (?l}vr  to  the  second  term  is 


0T  f,  +  A2  £•/ 

1-zl  (i*Z)1  <*>  £7^2 


-} 


For  very  large  (S/N)j  ratio 

<x>~* 

Consider  the  first  term  in  the  approximation 

4  -  ££  ••••  ( 

Approximately  replace  P"'  by  J  ,  Pk .  cm  -  9k)  by  X£g  and 

assume  we  may  use  the  product  of  the  expected  values 


Then 


e;/3* 


(x>  L 


( 


Collecting  results 

(£}~(p)r/  (P)rr  (*)  ZTt  fc« J  (“l) 

(113) 

For  a -constant 

where 

(114) 

/D -A  ..  erft  f  /3*G?j:  Ml  E/  1 

\p  i.z  tl"  W  «  cr  J 

(no) 

z  =  e;a‘  i5t<x>  =  /?‘<nHsA{x) 

(100) 

(n,\  .  ,£«  B  .  Bn 

v^k  ~  ZCT*  W  iA{,W 

(101) 

Consider  now  the  term 

where  ^x)  —  (~]T  (ft  a  -  9^  (95) 

But 


/Co4  (/3a-e)  —  ~~  xum  (/3^l -a)  +/3a  -  ej 


=  -~-/uxlfi(a-a)  xxri(fia  -6)- -&■  ^ fb  (a:a)  Aw^a-e) 

hz  0  o 


-  (l  *  •$•)>»/! t(i-4  % 

viz  Appendix  C, 

where  2.-  3  ■  is  the  error. 


To  a  first  approximation  assume 

3  -  a  is  Gaussian,  zero  mean,  variance 
fjj  is  independent  of  3-  3 
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.  -d&± 

we  then  have  &  e  *  - 


(115) 


These  approximations  will  be  valid  in  the  raage  1 


To  obtain  numerical  results  let  us  further  assume  that  /lz~  - 


We  then  have  for  the  mean-square  error 


/cz\  l+JL). 

\L  /  i-+z!L  (i+zf  (2  <*>/ 


where 


Z  -  /^(<&).<*> 


Thus 


el  b 

-  £f 

w 

/S-Ga1  ( 
l  +  z  \ 

z  /.+_L1+  ^ 

'  1  .%  j 

2  =->  1 

replace  1  *  -z  with  2L 

79  ^ ) *  m-s*)  0 +  MmQ  +<i>) 


(116) 

(100) 

(101) 

(116') 

(117) 


(We  may  use  this  expression  and  (115)  to  compute  the  relation 
between  (S/N)^  and<x^). 

Note  that  (x)  and  are  functions  of  (S/N)£'only  and  independent 
of  (to  a  first  approximation).  This  approximation  is  sufficient  to  show 
the  threshold  for  all  values  of  /3  £  4  . 


Figure  II- 1  was  computed  in  this  manner  and  shows  the  dependence 
of  eg- ft2 M$£  on  (S/N).  for  /3~1  ,  /3»»1  and  the  linear  asymptotic 
valid  for  large  (S/N).. 
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Extension,  to  ;EM 

Although  all  the  analytical  work  has,  concentrated  cn  the  phase 
modulated' case,  it  is  easily  extended  to  the  EM  case  by  the  following" method. 

In  FM  instead  of  usingy3a(t)as  the  modulating  function,  use  /3'j:dZ,a(z). 

In  the- discrete  ease  ** 


j-dr  m  ~  Ap,  L  Ax 

/» 0  ; 


:  Equation  (15)  Becomes 


**•*■+. £b'-£ 


no)  =  K  fdco  e  "  *  f'  ‘  ' 

*X:- 

Let 

ak  “  (>%  "  Tk-l)/4  »  k  -  i*2'  ••»**»■ 

a.  « 

In  vector  form- 


(118) 


(119) 


a  =  Q<> 


Thus 


^  U  e. 
4 


(120) 


As  in  the  PM^case*,  for  large  signal-to^noise  ratios  let  the  exponent 
Be  represented' by  the  function  £  .  • 

Then 

irS  ^  ^(^-0k)r^Q%Q^  =  0 

^  k*o.t,—,n  (-30  > 

(correspond  to:  equation  (38) 


%£~nk  “*(fii>rdk\  8kf  -  *a  V* 

(correspond  to  equation  (39) 


(39*) 


(121) 


af  A  -i-te-i 


ZiCo 


F  af; 

*  ^  'A  /i ,  !/  . 


IT  a’*to 


9*-?t-j 


when  ^  is- selected  as  the  solution  of  (38s) 
with  t-'fe  f=  o. 

Hence  the. MMSE  estimator  corresponding  to  of  the  PM 


case*  is 


0 


vr 


Where  is  the.  solution-  of  the-  equation 


(63») 


The:  matrix  P  of  PM  is  replaced  by 


P  * 


(43-1) 


For- the  first  term  in  the  error  c  we 


■ 


—  -j-  |  ^T  .  3Tt-/ 


1 


3iG>*  h  t;3£'to  3ito 


r'f-<  j 

ito  J 


(122) 


By- differentiating  38'  we  have 


r  — 3L- 
1  a 


U*  -  U-y-i 


2V 


where  tir  is  a  unit  vector  in  the  T  positron 


APPENDIX  H-A 

THE  , EFFECT  OF  LIMITED  RF  BANDWIDTH 


Consider  a  filter  with  a  fr  equency  response where* 


FC(u)  ■-  1  ,  \  uS  ±  ct£j  <  2.7T  —■ 
-  O  }  e/sew/tere 


(A-l). 


Let  the  input;  be  g  It),  then  the-  output  Jilt)  will  be 


kit)  -  F(u))cw*  FdT e  ■  MV g (.z). 

kctl  rj^dt  g0):  2  cez 
:ial.Case:s  : 


(A- 2) 


K  J7 dZ&'^^g.Czg^O'  for  all,  u>  wAefe  f( U>)  ~0  then-the  filter 

Has.  no  effe;ct,.  ' 

This  will  also  be  true  when. the  spectrum  of  y  is  O  where  /rC(^)=0i 
(Consider  a  s ignai'  gCt)  of  the  form. 


(A-3) 


where  h(tf  is  bandlimited  Gaussian  noise, 

a#his  a.  random  signal, 

Co0'  i?  the  carrier  radian  frequency 

do  is  the  carrier* Amplitude 
Ifajiis  a.  linear  operation  on  aft) 

If  the  s ignai.  g(t)  passes  through  a  linear  filter  with,  response  as  given 
by (A- i)  and  if.  the  spectrum  of  the  noise  is  constrained1  in  the  bandpass  region 
of  the  filter,  the  output; $(t)  will  b e t; 

A  ft)  ~  h(t)  +  fdr  So.  to*  (woZ+L  C&tt)))  2  c&a.M)a  (t-t) 

J  '  -J-oo-  Tr(t-Z)  (A-4) 
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Letting  n  (t)  =  n/:(t)  co<.  UJ0t  -  n^t)  4ml  uj0  t 

and  A tt)  =  A/ft)  c^0t^ji±(t)  4Mi  etf0t  }  We/i'Ave 


(A- 5) 


[** £■(<£(?))  tc<^CzaJo 

* 

At(t)  -nz(i)iJ'cir£0  1 4Mit(a.Ct)) -4Mt (2cJc?+L(k (t) )Jj  (A-6) 


if  the  carrier  frequency,  eo0  ,  is  very  large  compared  with  27F8 
contribution  from C°^Z‘iOc't-i-L may  be  neglected  when  studying  the 
low  frequency  output  oLthe  filter  .  Hence;  we  may  tise- 


4Mt:7Tj3  (t-t) 


4,  (t)  ~  n,  4 .** ■£(*<?)} 


4  it).  =  /7Z  (t)  +  f  dr l  fatty).  ^ 


4*rv7rb  (trt) 


(A -?) 


Wii-r) 


.  :  v 

if  the  spectrum  of  is  mostly  contained' in  the  bandpass 

of  the  fiiier  (i.  e>.;,  i£  (whejre  is  the  effective  upper  limit  of  the 

spectrum  of  ^Z/d/t))^  ),then>we  have 


Af  Ct)  =  h,  (t)  +  £o  .  go*  (L(ai 


4 


(A- 8} 


The^difference' between  equation  (A- 8)  and  equation^  (A- 7).  represents 
distortion  due  to  the:  bandpass  filter. 


APPENDIX  H-B 


RELATIONSHIP  OF  SUMS  TO,  INTEGRALS 


.Consider  a  matrix  T  where 


t- 


(B-l) 


and  where  /?£  is  a  covariance  matrix 

Let  /dg(Z)  f~c{co g?(wy  *  <p(<v Jisa  power  density  spectrum. 

Their  the  elements  of  the  covariance  matrix  wilt  be 


(B-2) 


The  matrix  equation  (  T  i-  <*-  /??)  *  =/' 

iVc  ’ 

maybe  written  Xn  =  //*  , m  =/,*, 


C3-3) 


{B-4) 


(B~5) 


Replacing  the  sum  by  an  integral 


X/n  *  Xn  A  — 


~Z)  =  where  X(/it£)  ~  Xjr. 


(B-6) 


Let  X  be  the  Fourier  transform  of  X  and  for  y. 
Then  ;  -  X  +  ^  X  -  / 


solving  for  X 


(B-7) 


yA.  > 

X  = 


inverting  gives 


y.(t)  - 

Z7rJ  /+  rg<f(u>) 


fdte  tti 


Tins  corresponds  to  the  vector  aSnuHon 


x  =  i 


)/  =  # 


X/n  =  £  T/nn  yr 


From  (B-8)  we  have 


F  ^Ayn  ~  Tdu}  — g- 


iuiA(n\-n) 
~<p(M  ) 


(B-8) 


(B-9) 


(B-10) 


Hence  the  approximation  Fma  is 


f~ctoo 


t+  <L  cp((v) 


&. fame1-*!-*'  rM 


(B-ll) 
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HI.  MINIMUM  MEAN  SQUARE  ERROR  ESTIMATION  OP  RANDOM 
ANGLE  MODULATED  SIGNALS; 

WITH  EMPHASIS  ON  THE  LOW  (S/N).  REGION 

1.  SUMMARY  : 

Section  2  presents  a  modification  of  the  development  in  Reference 
[l],  of  the  MMSE  estimate  of  random  PM  arid  PM  in  the  presence  of  white 
Gaussian  additive  noise.  The  result  is  expressed  as  a  quotient  of  two  infinite 
series  of 'Operations  on  the  received;  signal:  MMSE  estimates  are;  given  for 
both  the  case  of  known  RF  reference  phase,  as  well  as  uniformly  ran¬ 
domly  distributed  (RF  frequency,  transmitted  amplitude  and 

statistical-  characteristics  of  modulation  and  noise  are  all  assumed  to  be 
precisely  known  at  =the  receiver. )  _ 

'  In  Section  3  these  MMSE  estimates  are  approximated-by  the  leading 
term  in  the  series  :(hence  valid  for  sufficiently  small  input  (RF)  sigpal-to-noise 
ratios).  Expressions  for  the  output  signal-to-noise  ratios  in  this  asymptotic 
regime  are  then  derived.  It  is  found,  that  if  a,  very  long  observation  interval 
is  used  it  is  sufficient  to  restrict  one's  attention  to  the  case  of  known  <£  in 
order  to  characterize  the  asymptotic  output  S/N. 

Final  results  show  output  S/N  for  PM  and  PM  (both  zero  delay  and 
infinite  delay  cases)  as  a  function  of  input  signal-to-noise  ratio,  modulation 
characteristic,  and  modulation  index.  Typical  graphs  are  included  and  com¬ 
parison  is  made  with- large  signal-to.-hqise  asymptotic  results. 

2.  MINIMUM  MEAN  SQUARE  ERROR  (MMSE)  ESTIMATE 

Random- Phase  Modulation 

Let  the  modulation  a(t)  be  a  zero-mean  unit-variance 
stationary  Gaussian  process  with  covariance  function  and  let  n(t)  be 

bandlimited  white  Gaussian  noise  with  spectral  density  Nq  watts/Hz  (one-sided 
spectrum)  limited  to  a  band  of  width  2  SI  centered  about  cJa  (the  carrier 
radian  frequency).  Let  be  a  uniformly  distributed  random  phase; 
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furthermore  consider  a(t),  n(t),  and  $  to-be  mutually  independent.  The. 
received  signal  is  then assumed  to  be: 

=  E#  cat  [aj0t+  §?  +j3d(t)]  + A(t)  f1) 

where  £"a.  0Oo  y  and  J3  are  known  positive  constants  (the  last  being 
the  modulation  index).  Assume,  furthermore,  that  SI  is  chosen  so  that 
C  OJQ  ~SL  y  coa  i-  J2.J  encompasses  essentially  the  full  signal  power  spectrum 
as  well.  One  can-associate  2  SL  with  receiver  IF  bandwidth. 

;  The  problem  is  to  find  the  MMSE  estimate  of  a('j'),  .the 

modulation  at  time  ■£'  ,  based  on  knowledge  of  the  received  signal  over  a 
finite  time  interval,  OSt  £  T'fr  or  e#  for  short.  Denote  such  an 

estimate  by  T)  -  (or'  a.  (fiS),  where  e#  is  understood). 

We  assume  throughout  that  T  »  and  Q.  «  coa  (narrow 
banchsignais).  it  is  then  shown  that  (Ref.  [l]): 

-  a  (D  =  <*(?)/<%}  = 

where  j- 

Q-te/z,  &7a)  C  e^(s)  -Ea  Cot  (u)0s  *£+J3a  (sjfl  ds\^ 

aiid  where  the  subscripts  <§}  a.  indicate  that  expectations  are  taken  only  over 
the  joint  distribution’ of  $  and  d  =£a.(sj;  d  S  s  ~T^  with  regarded 

as  a  given  function.  * 

By  application  of  the  Karhunen-Loeve  expansion  for  a. 

* (0  -Z  A*  A}  <pi (Z)  ;  o  st £r  (3) 

i-f 


<*-&)CLCeto§,A  )>-  a 
<  <?  «)>%* 
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where  -J  are  the  (positive)  eigenvalues  and  corresponding  eigen- 

functions  of  the  integral  operator  with  kernel  f£a  (on  [OjT]  x  [0,  T]  )  and 
where  are  independent  standard  normal  random  variables.  We  can 

then  writs,  id  place  of  (2), 


CO  o 

fe*  Jt  y\ 


rl h  At  ?iW  )  o<r^t 

l-r 


where 


<Aj  <?>;#, a 
<Q>$,d 


The  narrow -band  assumption  permits  certain  simplifications 


to  be  made  ih/the  form  of  Q,  viz.  -, 


t&(s)  C*i($+j3 d(s)  +  0(s))cls 
Q  -  <fe  =  ^  * 


where  the  factpr  q  is  independent  of  0.,$  and  where  {  z,  9  }  is  a  normal¬ 
ized  magnitude  *  phase  representation  of  the  baseband  information  in  the 
received  signal,  viz.,  . 

e#  (  t  )  =  ya  (  t)  coa  t  +  yf  ( t)  Cd0 1 

Consequently  '(5)  becomes 

y\  CA;  ePy<[>  „ 

Ai  2  y '  <?> 

>i,i 

Next,  expanding  as  a  power  series  in  P  and  inter¬ 

changing  order  of  expectation  and  summation  we  obtain 

.  £  *  (8) 

,  ‘  '  *?«*>&. 


We  address  cdrselyej  to  tiie  iaskofevaluating  the  individual  expectations  in 
(8).  Note,  first,  Jb^|3)rasdbythe  independence.  of  §}  A/3A», _ _  3  that 

-  ASiri  yy /r  .'i  V  v  V  -  ,ni 


Next,  the-  follovring  assertioris  are  easily  verified: 


cc  £=/,2,- 


5  S***£^N* 


7T cc±  be.  =  2-£&*Cg  j  *  =  r>z> -* 

<?=/  .  '£■/  _ 

.  From  the  definition  of  P  in  (6)  and  identity  in  (12)  we  can 


=/4^  f-f'  r $zCs£)&AjE(j)0*  \C2j-n)2+%(p*(s„)+0(sa)) 

\2f/0  J  -or  \JEf? -  jy=^  L  *-r 

**..  -j 

“  2^  {pG'CSvrl+eC S„))  I 

J 


^  -  . 

The  notation  ^2  '  . 


means  that  a  summation  is  to  be  taken 


over  all  2,  possible  combinations  of  ig £.^ _ ,  n  .  For  example. 


7T  coceLj  =  2:*Jf  ^^4)  =  4  £«**(*,  +<*z}+  ’ 


rTr£=£hL=*>z  ■ 


^  c64-:(&/,  ~°t~z)  +~4<&  (  -*■/**'&) ;+■  cp*-  (-*/ 
+o^zy:+c^(ccr-</.z^\ 


Cons eqoantLy,  Dy  {§)  and  tee  permissible  inierenange  of  integration  and 


expectation: 


(fee  ©  expectation  feeing  zero  TKflienever  2.J  —vz  36  O  ). 

^ext,  (3),  (9),  (10)  [applied  repeatedly],  (11),  and 
Mercer's  Theorem,  yield 


<  Wj' (pcuCs^GCsJ))^ 

-jx=r  '  . 


Similarly,/  " 

<  Ai  can  ( 't  'A„sr  CA*< srn)*0(sm))) }a 

-  -J3lt(Z/'-£n  ecsjj 

(15) 

We  thiis  obtain  from  (4),  (8),  (13),  (14),.  and  (15):: 


where 


KZhm~-p(^)(^j  f4\frz(si)ds\  TjUj^^Csj-r) . 

*y  f  1  j~l. 

exp  Pojir,  &&.  (sf  -^J  j 

-2a 


In.  particular 


r  r- 


JCz(t)  *jpSr  (dsfjdsA ya (S})y, (sz)  -yf (s,)/(f < 


/?<tCs,-z)e 


-p2(r-zaCsrst)) 


0  0 


tz  =^r  fds^dsz  [/<,&,) ya (Sz)  *y, Cs^CSf^e * ^~ffa  (5/'Sz)) 


•  r  r 


o  0 


>The  hijove  solution  is-hased  on-' a  random- carrier  initial  phase 
.W  -  Ghrthe  other.'  hand,  if'  $.  were  Renown  precisely  at  the  receiver,;  then 
by  appropriate  modifi'eatiora  of  (13)  it  is  not:  hard  to:  verify  that  the  solution 
becomes-  ** 


oO 


where 


O 


As  affinal- note  to  this  section,  we  point,  out  that  the  stati'onarity 
requirement,  on;  a(t£  Is-,  not  essential,  but  imposed  only  to  simplify  the  present 
development.  It  can  be  .shown  that,  if  stationarity  is  not  assumed,  then  (with 
the.  covariance  R.^  n<^  a  ftuictioh  of  two  variables)'  all.  of  the  above  results 
continue  to  hoid?with  the.  exception,  that  . for  each;  appearance  of,  /?a  the 
minus;  sign:  in  the  argiunent  i’s  replaced-bya  comma-. 


ca 


Extension  to  GeneralizedFf  eqnency  -  PhaseModulation 
We  replace  (l)by 


-  £0  Co*  $  +n{t) 


{18} 


where 


o(t):  =(!+*) er6t'r) aCryd^j  r>o 


0 


all  other  quantities  being  as  previously  defined.  Note  that 

.  -  i'at) t lUt) 

/*r  : 

where  b'Ct)  is  the  derivative  of  b.(t)  If  we,  let  Y—+  00  then  {18}  reduces 
back  to  (1).  Thespeclal  case  of  ]f-*rO  corresponds  to  FM.  Positive  t 
representintermediate  forms  between  PM  and  EM. 

It  is  well  Known-  that-b(t).  is  also  a  zero-mean  stationary 
Gaussi&nproce'ss  with  covariance  function  defined  by; 


O+rf  r r,  "aj.i  -stT-v i-, 

=  J  %  6r)«  dc 


Then  by  (2X  we- may  write  the-.MMSE  estimate  of  b(’2" )  given;  e%  as 


and  tlie  series  solutions  (l6h  (17)  with  £?a  replaced  by  Ry  represents 
b(?)y  b6Z~  b~T  Furthermore,  it  can  be  shown  that 

b'm+rbciry 


J4*± 

r+r 


dr  *  b  (?) 
%  />r  / 


(19). 
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Thus,  (19)  together  -with  the  explicit  solution  for  b  (t  )  given, above  under 
replacement  of  Rg_  by  ^  describes  MMSS  demodulation  offM-PM 
withinfee  measurement  interval  [©,T]-  "This  result  is  a  special  case  of  a 
more  general  theorem,  namely,  feat  if  (18)  holds  and  b  =  [_  cl  where  f_ 
is  a  time-invariant,  invertible,  linear  transformation  (and  a.  is  as  pre¬ 
viously  defined),  then 

et.CV}  - C£!t yen  ;  o±r±r 


3.  ASYMPTOTIC  OUTPUT  SICEvAL-TO-ZiOlSE  RATIO  AT 
INPUT  SIGNAX.-TO-KOI5B  RATIOS 

Phn^e  Modulation  • 

Por  very  small  input  (RF)  signal-to-noise  ratios  fee  MMSS 
estimates  of  the  modulation,  Equations  (17)  and  (16),  reduce  (with  high 

"  4:  .  : 

probability)-  to  fee-approximate  formsr 


-e^f  5 i  ^  (s  T)  iS  5  =  0 


a.(z)  =  i 


fi  Ea  rTrl ,  *  ,  *  _ .  m  ,  ... 


fjx  I  j'fye(?y  e  d^d%; 

uniform  on  [o^z'xj 


a^o 


'Not.,  that  ,|  K,„|  ifi 

where  M  -  JTtlr(z  (P))  Hence,  appr oximation  by  leading  term  becomes 
vaiid.fof  a  small  input  sighal-to-noise  raUo-and  givenreceived  signal,  viz., 
when  r/Ve  <■<  M  1  .  One  should  be  careful  to  note  that  the  bound 

M  is  dependent  on  the  particular  signal  received  and  is  in  fact  itself  unbounded 
over  the  set  of  all. possible  signals.  However,  it  is  not  difficult  to  show  that, 
for  sufficiently  large  M,  p£/h<  M  j  can  be  made  as  close  to  unity  as 

one  wishes.  Similar  reasoning  applies  to.  L~jj  ,  K„  >  f_n.  Hence,  it  is 
necessary  to  qualify  the  above  approximation-by  ’'with  high  probability**. 


From  the  definition  of  %  ,  y,  -we  may  represent  these  as 

5#)  =  Ee  (p  ait)  +  §)  -h  ht  (t) 

%{x)  =  E0i^  §)  *  "*  ft; 

where  l*c  and  ns  are  independent  baseband  Gaussian  processes  each  with 
spectral  density  2Nq. 

In  view  of  the  nonlinear  operations  required  for  MMSE 
estimatiour of  angle  modulated  signals  there  is  no  uniquely  definable  output 
signal-io-iioise  ratio;  However,  we  shall  adopt,  as  a  natural  extension  from 
the  linear  case,  the  definition  of  output  signai-io-noise  ratio  given,  in 
Chapter  I,  viz;.. 


JO* 

•Ao  —  T~f* 


where 


/-I  aW) 
y  (  or  •  <r5  s 


(The  correlation  between  the  true 
value  of  the  modulation  and  its 
estimate). 


Note,  furthermore,  aproperty  of  the  MMSE  estimate  a.  (?)  ,  that  the 
error  must.be  orthogonal  to  the  estimate,  i.  e.  , 

(r)  -  a  (zj)  a  (?p  =  0 

Hence 

.  ,  :  «  (&2(4 

and 


<a(T)  aft))  _  '  c^; 


Gl1 


<£r 


We  proceed  to  compute  A0  for  the  above  two  asymptotic  cases: 


{o,x%} 
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\yt;(s)  =  -£0(a(tf^/3“6>)a  {by  virtue  of  a,  n 

independence  and  $  =  0 


=  -/?E6e~^,Ri( s^T) 


(See  Appendix  A) 


f/3»  (?,)>  #)  Mn  (/3d  (s2)  +  #  ))  a  (?j)t  ^ 


(Again. by  a>  n  independence) 


,  #  Ec?  («  W  (“  (5,)-  <■  Pi)))^ 


i  (See  Appendix  B) 

Hence,  for  sufficiently  small'  input  signal-to-nois e  ratios  (as  measured  by 
Ej/'Njj  )  the  output  signal -to-noise  ratio  is  approximated  by: 


|i  frffflh  <v*)Mv*>  -■**  (vr3  • 

§  uniform  on  [o ,  air] 

a#  *f-f  .•-.■■■  ; 


frS.y-  ■  . 

8  j  :}  §'  uniform  on'  fd»^v]. 


'!&***' 


' « '  * 
Cfe 


.  *?*  <*d 

Q  * 


i  Or 
o' 

o  f->-o 


-  ?  ~  v  &  '*  £ 

3  .  :  1*.  ■ 


jf  |R*Wj  ^t  <  ?°  for  some  .$  .»  6  )  that.as  T—r-f°  A.remains 
bounded  whereas -B’  — -i*-<eo  "  (see  Appendix  C).,  Since  knowledge  of  the  trans-? 

--s'  -»  ,  ^  ^  "  - 

mitted  reference  phase /cannot- result  ima  worsening  of 'the  estimate,  we  can 
be  certain^tHat  Aq;(^unifprm  on.  ![o?-27T-]Jl  £  A0(‘$  *  '0 },  Hence,  the 
validity  of  the  asymptotic  resdit  shown  for  the  case  of  uniform  on 

[0,  2  it  ].  nlust ;be  re  sir  jclied  to -ever  smaller  input  N0,  as  the  obser¬ 

vation  interval  is  lengthened.  An-  explanation  for  this  effect  is  that  whereas 
T  s  much.lbng^  tl^ri  ithe  modulation  correlation  time  provide  essentially 

)/  1  ,  q  *  jf  ,  v- 

no  improvement. for  the/ case  of  9  =  o,  ,  if  on  the  other  hand  9  is  a  . 

priori  unifor m  on:[0j>2 7F J/theh •fux.ther.  information' can  be  gained/by  very 
long  T  ,  hamelvi-ahJauxiliary  c e s timat e  of  $  which  approaches  the 
sitvtatiqii  df"kii6wn'i4:fixed^  $1;  as-  T  -rr*~oo  For  this  reason*,  if  we  restrict 
our  attention  to  the  ease- of  .  very  large  obseryation  intervals,  an  adequate 
representation?pf  asymptotic  behavior  of  JvlMSE.  phase- demodulation  at  low 
input  Eq/N0  Is  given  by-the  result  for  ar  0.  Explicitly,  for- -two 
valitbs  of  /fe 


It  is  of  int^test.to  note  (under  the  reasonable  condition: 


/ 


-  «r/7  ^  n  oo  ^  -I  j 

^  e  •  -  jr  M*Psj;  -l-JL  aero,  delay,  (if  =  t) 


Ao-i 


V 


,E2 


1  in£mte  deiaY  ■  (v-4-) 


(20) 


'•  Note -further  that  in- thl,'s regime  A  o  may  be  maximized 

-  2  v  O  ' '  -  „  ^  ' 

by  choice  of  ;  viz.. 


:  [e  |nRj,?;(s)3s|  ^  zero  delay  , 


T(A.M 


[*e-‘/,V  (<}<!•<],  !  ‘  , 


X  ' 


■’f  V-// 

*.5'-  !h.'-  '  >  . 


(21) 
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-0-, 


$  :  ■ 


E-~: 


<y..  ,■ 

'  -  i 


f\  V 


L.  *] 


I'V  ‘  »: 


For  the  special  case  of  modulation  a (t)'  having  a  flat  spectrum 


K  =  l 


7r  -  e  1WN. 


out  to  W  '(Hz):  and  zero  beyond,  (20) -becomes 

-----  =  -y-  e  (s/n)-  5  zero  delay 

A 


2WNd 


0 

a-  =?  y3z  e  ^  (V^)?'  »  infinite  delay 


(22) 


.where  (S;/N)..  = 


the  intrinsic  signal-to-noise  ratio. 


Note,  for  later  comparison  with -FM  results  that,  in  view  of 
the  normalized  definition  of  a{t),  /3  is, also  the  standard  deviation  of  the 
carrier  phase  due  to  modulation.  - 


.  ;  Comparison  with  Equation  (3)  of  Chapter  TV  of  this  report 

showjAhat  the  asymptotic. behavior  of  Ag  as  (S/N) i. - ■+■  oo  is  given 

(for’infinite  delay  case)by 

‘.V  .  Ab  .= 

FigUre  L:presehts-plots  of  R0  //^(S’/N)\  vs  /3  .  for  both  of  these  cases. 

The  difference^betweeh  these  curves  is  an  indication  of  the  severity  of  the 
threshold..  ItwilFbe  noted  that  the  high  and  the  low  (S'/N).  asymptotes 
/coincide  for  <<  1;  The  reason  for  this  is  that  with  y3  '< <  1  phase 

modulatiph-reduces  to  a;  linear  process  and  it  is  shown  in  Chapter  TV,  Append 
dix  C  of  this  report  that  foraiich  a  linear  system  A0 

'  v  ‘  ' '  _  ’ 

Fr  equericy-Rhas  i  Modulation.  - 

=  ;  GpnSiderncdv  the  casewhere  the  m6dulation.a.(t)is  .pre- 

emphasized  by  a  time-invariant,  invertible,  linear  transformation  L  to 
yield  b(t)  which  then  serves  as  the  phase  modulation  for  transmission.  At 

i  j  -  ^  ,  A 

the^receiving  end  a  MMSE' estimate  b(t)  is  made  and  this  is  then  subject  to 
,the  inverse  ’L~l  of  the  original  transformation  t6  yield  aft)-,  the  MMSE 
estimate  of.  aft)'  (see  :Section  2);  Our  particvdar  inter es.t  is  the  family  of 

transformations  "£.«  .  -'defined' '(for-  -t  >'  Q  •)  by: 

,-0  .  .  "  0  “  .  -  •  -  . 

a)ijtK=  fr  :*(r)  dr 

■  ,  ioo  _ 
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Recall  thatdhetwo  limits  (i)  J  -  -»■  -6°  arid' (iij  £ — ■—*-  o  correspond 
to  pure  PM’  arid  pure  FM  respectiyely; 

Returning  to  the  general  transformation  L  ,  we  repeat  the 

calculation  of 

...  p  ±  =  Mm  *(?>)$.  ffft)  aft)) 

=  ^  "'Gf-  •  Cg*  (J"a 

= 

as  previously  described  for  pure  PM,  but,  in  the  light  of  earlier  remar  ks  * 
only  for  the  case  $  *  0.  Some  of  the  strips  which  follow  require  detailed 
although:  straightforward,  justification  which  has  not  been  included. 


.  (a  w  a.W>  -  /(r1  b)(D  (L-‘  t)  (r)) 

.  •  '  ■  *  (l  !M(i;'w(S(u}bw))w](T) 

.  *  (L"(«)(L'‘(v)(-/9|f 

» 

’ 

The  use  of  dummy  variables  U,,v  serves  to  indicate  the  scope 
•'■ol  eacjh1-  ;  ‘operator^  : 


-where  (Tj?  j=-Rb(o.)  ,  3  the  yarzahce  of  b(t).. 


R;b  (s-lij  =  (*>&*> (vfy  =  ((La)  (s)  (u)  (u)^ 


=  \L[M):{Il(v)  (a(>).aYV^)(s))(u) 

_  .*  r 

=(L£a);  (Lfv)  Ra  (a-V))  (s));(u) 


Hence, 


A, ♦  W  A  fcs)  is)  ^ 


where 


0/  =  -?i aj  =~fcrM)C£m/r„  Cst-?))  (<» )  (»> 


Specializing:  C_  to  the  foi’m,  t  y  and  assuming  infihite  observation  time 
P  ~~*r  <**'  with  two  subcases  of;  zero  delay..  (  £  -T  ) and  infinite:  delay 
Z~—  .YzJf  .r  we  obtain:.  -  \ 


A°"  I  [Aw 0^/*  J  f* ;  ^ 


*rfe 


r/r  r  -r(v-si^  , 
/  7  <? 


T  _2 


0  *  S' 


where 


2  -  /> ^ 


(23) 


We.  specialize  further  to  the  limiting  case  Y 
pure  FM,  and  obtain: 


a*-  &  iy* 


£?  corresponding  to 


f,4<"  "K,(v)<fe  % 


2. 

Notethatfdr  this  limiting,  case  to  make  sense  must 

remain  finite  (otherwise  b(fc)  does  not  e;dst);  hence  we  require:. 


£>< 


JOeon 

r-o 


/Z 


<  oo 


is  thatthe  DC  power  spectraL  density  of  a(t)  must  be  zero.) 

The  above  restriction:  on. a (t)  is  of  course  not  an.  essential 
limitation  inu-actual  FM;  it  arises  here  because  of  the  needto  keep  b(t) 
stationary  so  *hat  the  prior,  stationary  analysis  could  be  applied.  It  would 
have  been  eliminated,  at.  the  cost,  of  additional  complexity,  if  the  more 
general,  nonstatiohary.  analysis  hadlbeen  employed.. 

J  -  m  t 

By  reversal  of  order  of  integration,  the  last  integral  factor 
(albng.with  cpefficient)  in  the  expression  for  _/L  can.  readily  be 

transformed  to;: 

%  f  d/l  f  dv\,e  R±  (i/i):Ro.(-0)  ;  zero  delay 

■Jo  Jo  -  L 

v-,  -  -  ;  ^  aO’  /r°°  .  . 

-  '  -  J?  f  dju.  J  diS  e  ^  Ra  (yu)  f?a,  (V)  ’  infinite  delay 
Jjoo-  Jl-C°>- 


Hence, 


I# 


K?  { 


I  fir 

L.  3. 


qM~p2  fe  • 

*  r  *erp  delay 

%  TlCe~%aly):  dy  }• 
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Again-,  air  in' the  PM  case,  .  A0,  can  be  maximized  with 
respect  to-  /3  by  requiring;  that  the  exponent  of  e  be  -1.  This' leads 
to: 


r 


MAX 

P> 


\  U. 

2e 


fe  T-P*  j^h"' l^e 


hm  J  -Wo  ,  v  . 
f-~o  T  j0  *  RL(y)  dy 


?N  *  { 


~1 

ie 


J*m.  f  f  dp.  g 
y«»o  f  J—oo  J -of* 


R*  W  M^) 


Um  _i_  r<T<,_  ~$'i  _  >;  «  j. 

j^rJ-  &  Ra  (y)  dy; 


_§£ 

w0 


j;zero  delay 


(25) 


p. 

j  infinite  delay 


and' 


;  -  f. 


Application  to-  Modulation  Functions  Having.  a  Bandlimited  White 
Spectrum  and- Cbmparison  withiLarge-Signal  Asymptotic  Result 

Consider  the  special  case  of  a(t)  with,  bandlimited  white 
spectrum; within  [•  ’].  We  then  have 


ft  /i’t  ^  a/Tf ;yytt: 

“  "  .  Z7r.(Wz  -  \A/t)t*. 


(25a) 


Equation  (Z4),  then  yields  for  the  infinite  delay  case  (£5ee  Appendix.  C):: 


-O' 


•fl* 


-JL 


p*: 

C.0 

N i,  ' 


=  Cgt  e  U*  (s/N)r  .#  FM-,  infinite  delay;  »/(.S/N)j, «'  i 


(26) 
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where 


_  ,  „  ,  /3 


the  standard-  deviation,  of  the  phase 
angle:  duetomod'ulation 
(See  Equations  (18)^  (23),  and 
first,  part:  of. Appendix  C). 


intrinsic  signal- to -noise  ratio 


Note  the  similarity  to  Equati  jn.  (22): for  the  PM  case. 

For  the  .ca.se  oflarge-  (S/N);  (and  infinite  delay)  we  compute 
the  output  noise  power;  to-be:  (see  Appendix. E) 

,,  ^  •87ra(wa3;-;Wl3).  No:  _  ■ .  air2  w,  wJ-%7^-  *  No 

n’M,  ■—  -  TT?  '  *  -.5-  ••  r  i,.'* 


3 W  Z  c 


Hence  the  output  signal-to -noise  ratio  is- 

/?2\ 


,  *».  _  <g>  „  <°?>  _  H- 

V>  ■  )■--/>*  -  (°?) -<**}  ~  Hi  n" 


.  ‘  infinite- delay. 


.»  1. 


-  ..  Wr  “S  »  J.I’I  v./.'vi- 

;  w+  ^ 

In* Chapter  IV,.  Appendix.  C'-ofTtHis- report  a. linear  analysis, 
appropriate  for  G"e  .<4  1- ,  yields.  EM-  output  sighal-to-noise  ratio  for 
bandlmuted  a(t)' valid:  for  all  (S'/N):  .  As.  yrouldbe  expected  this  general 
linear  result,  reduces  to  Equations:  (26)  and  (27)‘ for  (S/N)i  <<  lx  and 
(S/N)..  >  >  1.  respectively..  However,  except  for  (S/N).  :»  £  ,  linear 

analysis  loses  all  validity,,  for  larger  (Fg  • 

Figure  2' provides  plots  of  A0  /(S  /N)..  vs  for  the  two 

■ '  '  -  1' 

asymptotic  cases,,  Equations  (26)- and  (2.7;)'.  For  large  CTJ.  =  fi/i 7r.y  w,  ivx' 
ahdsmaii  or  moderate  the  difference;  between  these- two 

values,  (the  asynaptotic  intercepts  on; a  l'dg>rlog.  plot  of  A0  vs  (S/N).  ) 
is  an  indication  of:  the1  severity  of  threshold..  Note  that  for  smaller  (T©,  if 
^  is,  sufficiently  large,,  hot  only,  is  thresholding:  apparently  -absent'-  but 
actually  a  reverse  relation',  between  -asymptotic  intercept  occurs..  This 
phenomenon  is;  depicted  id  more  detail  Figure  3  which  shows  the  transi¬ 
tional  region  of  intermediate  (S/N)\  based-on  the  linear  analysis,  for  (Jg  «  L 
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given  in  Chapter  IV,  Appendix  G  of  this  report.  The  curves  for  CT0  =  .01 ,  .1 
and,  .  3  are  reasonably  Accurate,  but  that  for  GTq  =  i  is  already  too 

high  by  a  factor'  e£  about  G  at  the  left  end.  Unfortunately,  these  curves 
give- ho  quantitative  indication  of  the  threshold  type  of  transition,  at  inter¬ 
mediate  (S/N)  for  larger  values  of  Gg. 


4.  CONCLUSIONS 

An  analysis;  of,  angle  modulated  systems  operating  under  conditions  of 

'  .  Si 

very  ldv?  input  signal-to-noise  ratios  has  been-  carried  out.  Using  J\a  =  ~L_yt 

as  themeasure  of  :psrformance,  asymptotic  expressions,.  Equations  (20) 

and  (24)  for  J\0  in  terms  of  (S/N).  and  the  modulation  index,  were 

developed  for  both  PM  and  FM.  It  is  interesting  that  2\0  varies  linearly 

with.  (S/N).  at  very  low  (S/N)..  It  is  of  course  well  known,  viz  Chapters  II, 

IV,  and  V,  that  2\0  -varies  linearly  with  (S/N)^  well  above  threshold,  when 

the  modulation  spectrum  is  strictly  bandlimited.  The  results  here  obtained 

show  that  this  is  true  for  ali  modulation  spectra  at  very  small  (S/N).. 

"It  has-been  observed  (Chapters  II,  IV,  V)  that  the  severity  of  the 
threshold  increases  for  both  PM  and  FM  as  the  modulation,  index  is  in-  T 
creased.  Our  results  confirm  this  and  show,  that  the- ratio  between  the  large 
andvsmall .(S/N) /  asymptotes  of  vs  (S/N)^  increases  exponentially  with 

the  square  of  the  modulation  index,  (Equations  (22)  and  (25)  ).  The  results 
here  derived  are  in.  agreement  with-the  linearized  analysis  (Appendix  IV-C), 
which.is  asymptotically  valid  at  all  (S/N).  as  the  modulation  index  goes  to 
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T£e  pair Lj6a  {£):,  j$a(s)  J  i%  bivariate  normal  with zero  ine^n  and 
c  ovar ianca  matr  iic  -  •  r;  -  ' 

/  jf  A**fi-rT)  .  . 

.  •  jS 2  / 

Hence*  V  -  :s  °  =  "  K  -  •'  - '  '  •  •'  -  -  -  '  ;  ",  - 

<■  *  -  e  ■  ,  f  .  jSo-c*  -Y  P  *^y^**r 

f  j*  '  4  L  -  ^2<S”r)%  tly. 

,  '  *  *  »  •  .y"  3  ^  *  V  -W«p  -«»  _  .  _ 


-  ;  bo  gf  y  - 

RtCs-X)  f  ..  -  - , 

TJSTjSTj  %**r  e  ■  ^ 


.  V  «.  “  yzir  '  jQ  I  :  f  c 


±;A  M*-r)  e 


*  P  * 

-  ,  H  J  /  Ji 


appendix  hi-b 


The  pair  \  a('r)  JJi(Q{s/)-a(bz)  )  is  bivariate  normal -with  zero  mean 


:  and  -covariance  matrix- 

./  '  v?U-k&-.s&  / 

Transforming  from  <j  {■?■}. to  oCz^.  ~j$  $».  Csi  ~szy)  •Q&t) 

■wej  can  immediately  apply  the  result  of. Appendix  A  to  obtain 


=  0(PKW^r-^:(ll.i ?* -Tl-  fUCsi  -t>)-c 


Consequently, 


$  (ji  fry  sm  jtifcdTr  aOs^. 


{add  Ml  AQo  (pi)  -  W&J/a 

'  /fit  *3 1 


;  -A  (i^Ra.di  'SA\ 


N  -- 


"  -  APPENDIX.  IHrC 

W e  aretoprove-ander  the  hypotheses: 

Q  on  set  of  positive  measure;  { 

('Oj2  ^  di  <  co  for  some  5  ^  ° 


(i) 

/?a  #  0 

(ii) 

/1«bn 

that 


.nr 


.4 . / 

aSjds^- 


oo  J  j  \ t$-T)\L/?a (s, -  ?)  -  4 (s£ -*)] c 

The:  integral  expression  may  be  written  as: 

r  .*  ....  *  O  '  . 

fl  4%- V)  fZ'^**(s'~s‘\.dsz  -  fj  TRe.(s,-t)  /?a  (s£-?)e 


oo 


■ O  6 


OS/  d$2L 


t  Ky^Mstcfsj,  - 


“  Tc~  *fiZ  l T K<  4  -  ■ r)  </s  -  j£ '  \K*(s  -  f)  |  ds  I 


f  f  A  (s, T)Sa(sz-t)  e  2-/?  ^  3^Js,dsz 


'o  -0 


=  r- 


r  .  ^  >*: 

e: 


oo 


By  (i)  /  /?a4  C s  -f  )  ds  >  0  ;  therefore  we  are  done  if  we  can  show  that 

i  '  do-. 


-tin  I  JorK(s^)\ds  \  _  ^ 


T—^oo 


f'lZ: . 


;9.1 


•ter.'Jt- 


2-8 

■P'S 


By  Holder’s  inequality  With  ^  *  =  4  ~  f  * 


=  0  by  (ii) 
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appendix  hi-h 

The  limits  in  Equation  (24)  [Infinite  delay  case]  are  evaluated  for  R 
speiified'in  Equation  (25a)‘,  as  follows: 


.  Uu*  i  f.  ~Tf  -  . 

J  <?  R*  (y)  dy  = 


-£ni  6  -fy 

f-+o  3/ 


J  C  *y  Ra.  Cy)  4y 


J  -Y 

Jo 


*•  {7  * 

•fan,  f°°  -fY  AJt  y  —ydat  a),  y 

j-r*  L  '  J 


-apS,  df  ~ 

=  —L-  [  J _ Li  =  .1 

di-u,  [W/  tt>2j  cOjOi 


oj/OSz  Wj  W& 


Jam,  JL 
t"*0-  t-  S 


.  rOO  rco 


CO  'CO 


'^"V\(p)W  =  fco  fA 


—  OO  -£» 


~  y— »<?  y  J  d/A  &  (^/  fW 

—  00  -CO 

=  [/^  (m)  fjJi>-veUfia  (T>) 

CO  1 


=  £*•/ ^  ^wf  dv- v  J\(») 


(by  interchange  in  order  of  integration  of.  the 
2nd  term-  and  noting  that  Ra  is  an  even 
function) 
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4:  r°*  -fy  fS* 

'i-&i  *  J  e:  8a:(/t)j  d-p.  •  e.  (m*v  o)2  -0  -  ^uh,  a),  i>) 
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W/‘  CJj  (  Gfc  -'  (0/ 1 
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APPENDIX  HE-E. 

For  very  large  (S  /N).  the  output  noise  power  spectrum  of  an  FM 
(conventional  or  MMSE),  receiver  is  known  to  be  (Chapter  II  of  Ref.  [2]  ). 

.  ,  X  Mi 

The  output  signal  spectrum. is  of  course  identical  to  the  input,  viz. , 


SM  \  5  V,  <\(*>\<  0>L 

l  o  ,  elsewhere 

Applying  Wiener 's  result  for  mean-square  error 


we-  obtain 
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IV.  "MONTE  CARLO"  EVALUATION  OF  THE  PERFORMANCE 
ATTAINABLE  WITH  PHASE  MODULATED  SYSTEMS 

Analytical,  investigation  of  the  performance  of  angle  modulated  systems, 
viz.  Chapters  II  and  HE,  is  difficult  and  does  not  yield  closed  form  expres¬ 
sions  valid  at  all  signal -to-noise  ratios.  Further,  it  is  necessary  to  assume 

that  the  modulation  as  well  as  the  noise  processes  are  Gaussian  ir.  order  to 

[1  Zl 

proceed  with  the  analysis.  Most  of  the  earlier  analyses1  ’  J  were  concerned 
with  the  maximum  likelihood  or  maximum  a  posteriori  estimation  (MAP), 
while,  the  analyses  presented  in  Chapters  IE  and  m  are.  primarily  concerned 
with  minimum  mean- square  error  estimation  (MMSE).  Analytic  similarities 
between  MAP  estimation  and  the  operation  of  a  phase-locked  loop  (PLL) 
have;  frequently  been  noted  (viz.  Chapters  IE,  V  and  [3,4]).  However,  when 
phase-locked,  loops  ar.e  used  the  performance  of  the  system  is  presented  in 
practice  by  a  curve  of  MSE  (or  output  signal-to-noise  ratio)  vs  input  signal - 
to-noise  ratio.  Although  it  is  known  that  the  MAP  and  MMSE  estimates 
approach  each  other  asymptotically  at  large  (S/N).,  it  has  not  yet  been 
possible  to  determine  their  relative  performance  in  and  below  the  threshold 
region  by  analytic  techniques.  For  the  above  reasons,  a  "Monte  Carlo" 
evaluation  of  a  PM  system,  which  can  be  carried  out  at  all  input  signal-to- 
noise  ratios,  was  performed  with  the  use  of  a  digital  computer.  This  evalu¬ 
ation  yielded  upper  bounds  on  the  mean- square  error  resulting  from  use  of 
the  MMSE  and  MAP  estimators.  It  was  found  that  the  evaluation  of  the 
performance  of  an  optimum  PM  system  by  the  technique  described  below  is 
quite  straightforward.  Because  only  limited  computer  time  was  available 
for  this  investigation  the  range  of  parameters  which  could  be  explored  had  to 
be  limited.  However,  the  techniques  described  can  readily  be  extended  to 
cover  a  wider  range  of  modulation  processes  and  parameters  than  reported 
here.  In  order  to  facilitate  additional  investigations,  the  complete  computer 
program,  written  in  FORTRAN  IV,  is  reproduced  in  Appendix  IV -A.  The 
results  obtained  are  in  agreement  with  the  analytical  results  of  Chapters  II 
and  HI,  wherever  such  a  comparison  can  be  made.  In  addition,  the  curves 
presented  give  valuable  insight  into  the  behavior  of  angle  modulated  systems 
operating  under  conditions  for  which  adequate  analytical  techniques  are  not 
available-. 
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As  discussed  in  Chapter  I  the  performance  of  an  analog  communication 
system  may  be  conveniently  described  by  Specifying  the  mean-square  error 
between  the  original  modulation  a(t)  and  its  estimate  a(t)  or  by  the  quantity 

j°  ^  3. 

A0  =  s-/>2.  where  fi-  is  the  square  of  the  correlation  coefficient 

of  a(t)  and“a(t).  Both  of  these  performance  measures  have  been  compnted 
and  plots  o£  (t}*s£~)  A0  vs  intrinsic  signal -to-ncise  ratio. 


|  S  \  _  I _ CjgglEK  PCftfEH _ ^ 

[fit  ji  ~  UF  NOISE  PG*ER  fR  THE  WDUUTJOS  8WDWD7H  ] 


are  presented  in  Figures  IV-1,  IV-2.  It  will  be  noted  that  these  curves  are 
in  dose  agreement  for  [Sf N).  such  that  operation  is  above  threshold  and  also 
into  the  threshold  region.  The  behavior  well  below  threshold  differs  mark¬ 
edly  as  one  would  expect  from  the  discussion  in  Chapter  I.  It  can  also  be 
seen  that  the  scatter  of  the  experimental  data  for  small  (S/N).  is  much 
greater  for  _A.0  than  for  expressed  in  dh.  The  reason  for  this 

is  that  the  evaluation  of  these  quantities  is  based  on  a  finite  amount  of 
experimental  data  and  that  at  small  (3/N)_  ,  /10  is  much  more  sensitive 
to  experimental  errors  than  (  (see  Appendix  IV -D).  This 

observation  should  not  be  construed  as  a  shortcoming  of  A0  as  a  measure 
of  performance.  In  fact,  it  is  the  predictability  (and  hence  the  low  informa¬ 
tion  content)  of  the  experimental  MSE  at  low  (S/N).  which  makes  it  insensitive 
to  experimental  errors. 

Well  above  threshold  the  RF  noise  in  a  finite  bandwidth  &  ,  will  with 
high  probability  have  a  small  magnitude  compared  to  the  amplitude  of  the 
RF  carrier.  Under  these  conditions  one  may  consider  the  effect  of  the  RF 
noise  on  a  phase  modulated  signal  to  be  a  small  perturbation  of  the  received 
phase  angle.  The  asymptotic  performance  for  large  (S/N)^  can  then  be 
determined  by  inspection  of  the  phasor  diagram. 

5$; 

The  computer  printout  from- which  Figures  IV-1,  2,  6,  were  plotted 
is  presented  as  Appendix  IV -B . 
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The  received  phase  angle  differs  from  the  transmitted  phase  angle 
by  &$>  -  For  (S/N). >>/,}*,  J  <<£0  and  Aj>  ~ 


Ref. 


n2  is  a  lowpa3s  bandllmited  white  Gaussian  random  process  with  bandwidth 
B/p  equal  to  half  the  RF  bandwidth  and  power  density  2.  ffe  equal  to 
twice  the  power  density  of  the  RF  noise.  The  modulating  signal  a(t)  is 
restricted  to  a  bandwidth  VI  -  8j^  Hz  where  M  is  the  bandwidth 
expansion  factor.  Errors  due  to  components  of  n2  falling  outside  of  the 
band  O-  W  Hz  can  be  eliminated  by  a  lcwpass  filter.  The  mean-square 
value  of  over  the  band  0-¥S  Hz  is  2  N0  W.  So  that  the  mean-square 
error  in  the  filtered  phase  angle  becomes 


<  (<P  -  $rP  =  £5$  =  l&f- 


(2) 


_  RF  Noise  Power  in  the  Bandwidth  of  the  Modulating  Signal  _ 

Carrier  Power 


(S/N). 


-1 


In  Appendix  IV-C  it  is  shown  that  in  the  limit  PM  and  FM  may  be 

treated  as  linear  modulation  systems  at  all  (S/N)^.  For  PM  as  -*■  0 , 

A0  — »  fiZ  (S/N).  for  all  values  of  (S/N).,  which  agrees  with  Equation  (2) 
above  which  i3  valid  for  (S/N).  -*oo  and  all  values  of  yS  • 


Note  that  Equation  (2)  is  independent  of  the  modulation  index  y3  or  the 
bandwidth  expansion  factor  fA  -  B/vJ  However,  the  assumption  that 
\nf  |f  j»£|  <<  E0  requires  that  (S/ N).  be  increased  as  M  is  increased. 
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-  <7* 

Since  the  mean-square  phase  error  in  the  asymptotic  region  is 
inversely  proportional  to  (S  /N).  the  abscissa  of  Figure  IV-1  can  also  be 
labeled  -with  K(<p~^T) 2 in  radians  ,  but  this  scale  is  applicable  only  in 
the  high  signal-to-noise  ratio  region,  where  the  above  asymptotic  approxi¬ 
mations  are  valid. 

Since  £  =  j3&  the  mean-square  error  in  the  estimate  of  the  modulation 
is  related  to  the  mean-square  error  in  the  estimate  of  <pT  by 


MSE  =  = 


qzi  i 


(3) 


Therefore,  the -ordinate  of  Figure  IV-1, 


Q5Z 

MSE 


& 


Note  that  this  relationship  is  valid  for  all  operating  conditions,  i.  e. ,  below 

ff-2 

as  well  as  above  threshold.  The  asymptotic  relationship  between  — — 

MSE 

and  the  RF  signal-to-noise  ratio  -is  given  by 


■'a.- 


A ISf 


2  f/0W 


fi  °t  (5/*)i 


=  /3z<Zz  TTZTa  =-/>** 


'ftp 


(4) 


Note  that  this  result  is  in  agreement  with  the  asymptotic  form  of  the  results 
of  the  MMSE  analysis  of  Chapter  IE. 

In  Figure  IV-1  the  above  asymptotic  expressions  are  plotted  together 
with  the  experimental  data.  The  agreement  between  theory  and  experiment 


*- 

The  filtered  phase  error  is  a  mathematical  entity  defined  by 
K($-pr)2>  =■  M<($-a)Z>  It  may,  however,  be  compared  with 
the  phase  error  existing  in  the  low  frequency  equivalent  of  a  phase-locked 
loop.  (Chapter  V). 
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is  seen  to  be  excellent.  This  result  is  important  because  the  experiment  was 
performed  in  a- theoretically  optimum  manner,  while  the  analytical  expression 
was  obtained  by  the  use  of  several  simplifying  assumptions.  Since  a  phase 
detector,  followed  by  an  optimum  (Wiener)  filter  has  the  same  asymptotic 
behavior  as  derived  above^lt  follows  that  improvement  of  performance 
through  the  use  of  more  sophisticated  demodulation  techniques  cannot  be 
obtained  in  the  large  (S/N).  region  where  the  asymptotic  results  apply.  The 
moist  important  goal  from  a  practical  point  of  view  is  to  approach  the  asymp¬ 
totic  performance  at  lower  (S/N)^,  i.  e. ,  to  extend  the  threshold  as  far  as 
possible  toward  ibwer  .(S/N)..  Threshold  is  usually  defined  as  that  value  of 
ihpuf  signal-to-noise  ratic  below  which  the  output  signal-to-noise  ratio  is  no 
longer  linearly  related  to  the  input  signal-to-noiserafcio.  Therefore,  in  this 
program  threshold  occurs  at  a  value  of  (S/N).  below  which  begins  to  devi¬ 

ate  significantly  below  the  value  predicted  by  the  linear  asymptotic  formula 
While  the  asymptotic  formula  gives  no  indication  of  where  threshold  will 
occur,  one  may  speculate  that  the  threshold  occurs  when  the  mean-square 
filtered  phase  error  reaches  a  critical  value.  From  the  discussion  above 
the  mea.n-.square  filtered  phase  error  expressed  in  decibels  is  linearly  re¬ 
lated;  to  the  ordinate  of  Figure  IV- 1.  This  relationship  can  be  expressed  as 

(°A)db  =  [^*°2]db  ~I .  (5) 

The  experimental  data  suggests  that  threshold  occurs  at  (S/N).  ^  7  db, 

&  2  1 

which  corresponds  to  a  value  of  G^<p  ~  .  2  radians  as  predicted  by  the 
linear  theory.  The  threshold  effect  is  seen  to  become  much  more  pro¬ 
nounced,  i.  e. ,  the  departure  from  linearity  becomes  more  rapid  as  the 
modulation  index  yd  is  increased.  There  is  indication  that  tne  threshold 
value  of  (S/N)^  increases  (  0^^  decreases)  somewhat  as  increases; 

this  behavior  was  predicted  on  theoretical  grounds  in  Chapter  I. 

There  appear  to  be  two  contributory  components  which  cause  the 
threshold.,  The  first  is  the  nonlinear  increase  in  output  noise  as  the  input 
signal-to-noise  ratio  is  decreased.  This  phenomenon  occurs  when  the 
assumption  (KE-o  is.  no  longer  tenable.  The  second  component  is 

caused  by  "ambiguities”,  that  is,,  errors  in  ^  by  integer  multiples  of 
2  IT  .  With;  the  modulation  restricted  to  the  range  [-1,  +,l]  ambiguities  can  be 
encountered  only  when  yd with  either  maximum  a  posteriori  (MAP)  or 
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minimum  mean- square  error  (MMSE)  estimation.  A  detailed,  discussion  of 
the  MAP  mid  MMSE  estimation  procedure  is  presented  below.  For  the 
present  it  suffices  to  note  that  with  either  procedure  the  estimate  of  the 
modulation  cannot  fall  outside  the  range  [-1,  +.1].  With  PM  and  an  observa¬ 
tion  of  the  received  signal  at  one  instant  of  time  only,  it  is  possible  to 
determine  the  phase  only  modulo  2  "TZ  .  In  the  absence  of  noi&e  the  resulting 
ambiguities  can  be  resolved. by  examining  the  time  history  of  the  received 
signal.  When  a  small  amount  of  noise  is  added,  the  resulting  phase  estimate 
is  perturbed,  but  no  difficulty  in  resolving  the  ambiguities  is  encountered. 
The  estimates  of  phase  deteriorate  at  first  in  direct  proportion  to  the  noise 
power  and  then  more  rapidly;  this  is  the  first  indication  of  threshold.  As  the 
noise  is  increased  still  more  the  ambiguities  can  no  longer  be  resolved  and 
large  errors  begin  to  occur.  Because  of  the  noise  these  large  errors  are 
not  exact  multiples  of  2  7T .  We  have  adopted  the  convention  of  calling  an 
error,  the  magnitude  of  which  exceeds  7T  radians,  a  click.  Figure  IV -3  is 
a  plot  of  the  click  probability  with  MAP  estimation,  versus  intrinsic  signal- 
to-noise  ratio  with  /3  =  8.  Comparison  with  Figure  IV- 1,  IV -2,  shows  that 
clicks  set  in  at  an  input  signal-to-noise  ration  in  the  vicinity  of  threshold. 
The  extremely  rapid  increase  in  click  probability  causes  the  rapid  deteriora¬ 
tion  of  the  output  estimates  encountered  below  threshold  when  large  values  of 
modulation  index  are  used.  As  the  input  signal-to-noise  ratio  continues  to 
decrease  the  continuum  noise  and  the  clicks  due  to  ambiguities  merge.  At 
moderate  signal-to-noise  ratios,  just  below  threshold,  it  is,  however,  easy 
to  differentiate  the  clicks  from  the  continuum  noise.  The  set  of  histograms. 
Figures  IV -4,  IV-5,  give  a  good  illustration  of  how  the  output  error  distri- 
bution  changes  as  a  function  of  input  signal-to-noise  ratio. 

In  general  the  MMSE  estimate  a  can  take  on  a  value  where  the  prior 
probability  density  f(a)  is  zero.  However,  this  is  not  possible  when  the 
prior  distribution  is  n'ori-zero  over  a  connected  set,  as  is  the  case  with  a 
uniform  distribution. 

Only  the  results  of  MAP  estimation  are  shown  in  Figures  IV-3,  4,  5. 
The  reason  for  this  is  that  the  computational  effort  required  for  the  MAP 
case  is  considerably  less:  than  for  the  corresponding  MMSE  case  because 
the  estimates  always  coincide  with  the  quantized  values  of  a(o )  in  the  MAP 
case4 


PROBABILITY  OF  CLICKS 


The  performance  of  the  MAP  and  MMSE  estimators  is  evaluated  either 
in  terms  of  the  mean-square  error  or  the  parameter  A0  =  jzjo*  These 
performance  measures  can  be  evaluated  empirically  by  a  Monte  Carlo 
technique,  provided  that  the  estimate  a  can  be  determined  for  all  noise 
perturbed  signals.  A  sufficiently  large  number  N  of  pairs  (a,  a)  are 
generated  in  accordance  with  the  appropriate  signal  and  noise  statistics  and 
the  sample  mean-square  error,  the  correlation  coefficient  and  A0  are 
computed  as  follows: 

we*  7 rS 

H 

2  ( ai  (  It  is  assumed  that  ^ 

77i 

We  assume  that  the  modulation  a(t)  is  strictly  bandlimited  to  the  band  o-w, 
Hz,  a(t)  is  then  recoverable  from  samples  spaced  seconds  apart  by 

means  of  the  interpolation  formula 


sin  ? r  (iwt-i) 

rr(Zrti-i) 


(7) 


/ 

Therefore,  only  the  values  of  a  (-j^r)  need  be  estimated.  In  principle 

the  entire  set  of  J  is  to  be  chosen,,  based  on  the  observed 

received  waveform  and  the  prior  statistics  of  Jw)  J  anc*  t^ie  additive 
noise.  The  complexity  of  the  resulting  siraulation  grows  exponentially  with 
the  number  of  samples  which  must  be  considered.  Clearly,  if  the  value  of 
all  of  the  samples  except  one  were  known,  the  estimate  of  the  remaining 
sample  could  only  be  improved  and  the  complexity  of  the  simulation  would  be 
greatly  reduced.  We  obtained  upper  bounds  on  the  attainable  performance 

by  setting  a  (  J  =  O  for  all  i  ^  O.  In  an  actual  system 

where  the  values  of  £j +0  are  not  known,  the  errors  obtained  in  estim¬ 

ating  OlCo)  would  therefore  be  greater  than  those  observed  here. 

The  problem  was  thus  reduced  to  obtaining  an  optimum  estimate 
based  on  observation  of  the  received  signal  *#(()  -  6r(t)  n  (t). 
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The  transmitted  signal  is  assumed  to  be  phase  modulated  in  accordance  with 
Qj  [a(t)]  s  Za  COS  C,ctf0  t  &(£)  ]  •  Thus  the  RF  phase,  in  the  absence  of 
modulation,  is  also  known  to  the  receiver.  (This  phase  can  be  ascertained  by- 
averaging  over  a  sufficiently  long  time. ) 

In  the  simulation  it  is  a  practical  necessity  to  work  with  low  frequency 
equivalents  of  the  actual  RF  signals.  For  this  purpose  it  is  convenient  to 
use  the  in-phase  and  quadrature  components  (using  cos  t  as  the  reference) 
of  the  RF  signals.  The  rate  at  which  these  components  can  change  is  deter¬ 
mined  by  the  RF  bandwidth.  Limiting  the  RF  bandwidth  to  B  Hz  permits 
the  in-phase  and  quadrature  components  to  be  reconstructed  from  samples 
spaced  1  seconds  apart.  Increasing  the  RF  bandwidth  thus  requires 
more  samples  to  be  taken  (and  consequently  increases  the  cost  of  computation) 
but  can  only  lead  to  improved  performance.  However,  the  improvement  can 
be  expected  to  level  off  rapidly  once  a  certain  point  has  been  reached.  A 
method  of  choosing  the  RF  bandwidth  as  a  function  of  modulation  index  will 
be  described  subsequently. 

With  an  RF  bandwidth  of  B  Hz,  the  sampled  values  of  the  in-phase 
and  quadrature  components  of  received  signals  can  be  generated  as  follows 
(this  is  the  same  technique  as  used  in  the  analyses  of  Chapters  II  and  IH): 

aB  fi)  -  ef  cos  tOo  t  -  e2  (t)  set?  co0 1 

where  ,,  .  _  „  , ,  ,  , ,  . 

e,(i)  •  E0  cos  /3ft  (t)  +  nf  (i) 

es(t)  =  £  sin  fla(t)  +  n 2  ( t) 

(8) 

let  A  «  J/B 

e,  (K A)  =  £0  cos  fia  (ka)  +  nf( ka) 

e2(KA)  =  E0  sin  p*(KA)+r\z(fi&) 


Assuming  that  the  noise  is  -white  and  Gaussian  over  the  F.F  bandwidth,  with 

intensity  N0  watts/Hz,  f)  f  n are  independent  zero  mean 

& 

Gaussian  variables  with  variance  NQ  B  .  Since  the  modulation  function 
a  (o)  '.rry^e^ '  approaches  zero  asymptotically  for  large  )t} 

and  all  finite  values  of  a  (o)  it  is  necessary  to  limit  the  observation 
interval;  however,  the  performance  is  hardly  degraded  when  the  higher  order 
sidelobes  as*e  eliminated.  Examination  of  the  ~c~^ -  function^ndicated  that 
an  observation  interval  which  includes  the  main  lobe  and  the  first  two  side- 
lobes,  on  each  side  of  the  main  lobe,  should  be  satisfactory.  This  conclusion 
was  experimentally  verified  by  observation  of  the  dependence  of  the  MSE 
which  was  obtained  as  the  length  of  the  observation  interval  was  varied.  The 
results  obtained  are  plotted  in  Figure  IV-6  for  intrinsic  input  signal-to-noise 
ratios  (S/N)^  of  +6  and  +22  db  corresponding  to  operation  just  below  and  well 
above  threshold.  From  the  figure  it  is  apparent  that  extending  the  observation 
interval  beyond  the  first  two  sidelobes  does  not  improve  the  performance 
appreciably. 

A  uniform  a  priori  distribution  of  a(o)  over  the  range  [-1,  +1]  was 
used.  Therefore,  the  phase  deviation  at  t  -  o  •was  uniformly  distributed 
over  [-  /3  ,  +  ft  ]  radians.  In  order  to  carry  through  the  digital  evaluation 
it  ^s  necessary  to  quantize  this  range.  The  magnitude  of  the  quantum  steps 
is  determined  by  the  more  stringent  of  the  following  requirements.  The 
quantization  steps  must  result  in  errors  which  are  negligible  compared  to 
the  errors  due  to  the  thermal  noise  and  the  quantization  steps  of  the  phase 
ang^e  must  be  sufficiently  small  so  as  to  present  a  good  approximation  of 
the  sine  and  cosine  functions.  At  low  (S/N)^  where  the  second  requirement 
is  more  stringent,  20  equal  quantum  steps  were  used  with  ft)  4  and  40 
steps  with  ft  =  8.  This  corresponds  to  a  maximum  phase  increment  of 
.4  rad  »  22.  8°.  At  large  (S/N)^  where  the  quantization  noise  with  20 

(or  40)  steps  would  be  comparable  to  or  greater  than  the  errors  due  to  the 
thermal  noise,  the  number  of  quantum  steps  was  increased  tenfold  to  200  or 
400  equal  steps.  These  two  cases  are  differentiated  on  Figures  IV-1, 2,4,6 

The  in-phase  and  quadrature  noise  components  are  independent 
provided  the  noise  spectrum  is  even  about  u)0  . 
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by  the  terms  “coarse”  and  "fine”  quantization.  Figure  IV- J  for  (S/N).=  25  db, 
illustrates  why  it  is  necessary  to  go  to  a  finer  quantization  with  large  (S/N^. 
In  this  case,  when  the  coarse  quantization,  21  sample  values  of  a(a),  hence 
20  quantum  steps,  was  used,  the  MAP  estimate  of  <zfo)  always  coincided  with 
the  correct  value  of  a(o)  ,  the  mean- square  error  would  therefore  have  been 
zero.  However,  when  the  number  of  sample  values  of  a(o)  was  increased  to 
401  the  error  assumed  a  distribution  centered  about  the  true  value  and  the 
mean-square  error  observed  had  a  value  :.n  agreement  with  the  asymptotic 
theory. 

Let  us  briefly  review  the  criteria  by  which  the  maximum  likelihood, 
the  maximum  a  posteriori  probability  and  the  minimum  mean-square  error 
estimators  determine  their  estimates. 


1.  Maximum  Likelihood  Estimation 

For  any  received  signal  e^li)  the  maximum  likelihood  estimator 
designates  that  modulation  a,  (0 which  maximizes  the  conditional  probability 
of  obtaining  the  observed  received  signal.  This  is  the  probability  that  the 
noise  will  be  such  that  when  it  is  added  to  the  transmitted  signal  eT  ( CL ,  i) 
which  results  from  modulation  with  a(t),  the  observed  received  signal  will  be 
obtained.  Qi(t)  is  therefore  that  function  which  maximizes  p  (eRl  q)  as  a 
function  of  O  (i)  It  is  to  be  noted  that  knowledge  of  the  statistics  of  the 
modulating  signal,  i.e.,  its  prior  probability  density  p(a) is  not  required  j 

in  order  to  obtain  the  maximum  likelihood  estimate.  All  that  is  required  is  j 

knowledge  of  the  modulation  process  and  the  noise  statistics.  j 

2.  Maximum  a  Posteriori  Probability,  MAP,  Estimation 

For  any  deceived  signal  i)  the  maximum  a  posteriori  prob¬ 
ability  estimator  designates  that  modulation,  "ctgfi)  which  maximizes  its 
a  posteriori  probability  density.  (7-,  is  therefore  that  function  which 
maximizes  -p  (q  /  ffRJ.  The  relationship  between  the  maximum  likelihood 


The  nomenclature  is  not  consistent  throughout  the  literature.  In 
particular,  the  terms  maximum  likelihood  and  maximum  a  posteriori 
probability  estimator  are  frequently  used  synonymously,  viz.  Ref.  [1,2]. 


estimator  and  the  maximum  a  posteriori  probability  estimator  can  be  devel¬ 
oped  with  the  aid  of  Bayes  theorem  / 

■pfa,  eR)  -  -p  (z  lej  f  te*)  ~  'p  .f%  lq)f  (a) 


For  a  given  received  signal  eR  (*) 

ffdle*)  =  /if  (eR)a)j>fa) 

from  which  it  is  seen  that  the  conditional  probability  density  of  f given 
a(t)  (which  is  maximized  by  the  maximum  likelihood  estimator)  must  be 
multiplied  by  the  a  priori  probability  density  of  the  modulation  in  order  to 
determine  the  maximum  a  posteriori  probability  estimate.  Note  that  the 
maximum  likelihood  and  the  maximum  a  posteriori  probability  estimators 
perform  identically  when  -p(&)  is  a  constant. 

3.  Minimum  Mean  Square  Error,  MMSE,  Estimation 

For  every  received  signal  eR(0  the  minimum  mean-square  error 
estimator  designates  that  modulation  ( t)  which  results  in  the  minimum 
conditional  mean-square  error.  Qj(^jis  therefore  that  function  which 
minimizes  j 

It  is  easily  shown  that  G$(t)  =  I (&))  =  conditional 

expectation  of  a(t)  given  (t), 

viz.  <(c^-ctj2  /  (?j?>  =  a^2-  Za3  <'taleq>  +( 

—  '  -  =  Za3  -£<olen>  =  0 

^3  ^  *  (9) 

For  all  of  these  estimators  the  major  problem  is  to  evaluate 
the  likelihood  function  as  a  function  of  a(t). 

For  the  case  of  additive  noise  the  probability  density  -f}(SR\aJ 
that  a  particular  received  signal  e r  (t)  is  the  result  of  adding  n  (t)  to  a 


particular  transmitted  signal  eT  ( t)  is  equal  to  the  probability  that  the 
noise  ri(t)  s  eR  (t)~  ( t)  For  white  Gaussian  bandlimited  noise 

*f>  (n(‘))  =  H exp^~-Jn*(r)d't  =  Ke*^  (er(T)  -  eT  (r)J  2  dr 

-  K ex^J fa  M  -  [a f  (*r  la)  (10) 

where  Cj •  jet  (?"),  t]  Is  the  RF  signal  corresponding  to  the  modulation a(r), 

in  principle  tho  likelihood  function  can  be  determined  empirically  by  means 
of  the  above  formula*  One  would  select  a  sufficiently  dense  set  of  a  (t)  and 
evaluate  the  likelihood  function  at  each  of  these  points,  each  point  correspond¬ 
ing  to -a  particular  function  a(f):in  a  high  dimensional  signal  space. 

The  difficulty  with  this  approaches  that  with  typical  parameter 

angle  modulation,  even  for  relatively  simple  statistics  of  (a),  the  number 

of  candidate  functions  a  (nr)  required  for  evaluation  of  a  single  likelihood 

function  is  untractably  large.  By  restricting  the  modulation  function  to  be  of 
,  v.  /  *  sin  Z  tt  W-  i  ,  ,  ,  ,  ,  ’  ’ 

the  form  a[o)  w l -  the  Pr°hlem  18  reduced  from  a  vector  estima¬ 

tion  to  a  scalar  estimation  problem; instead  of  estimating  the  function  a(t) 
only  its  value,  a(o)  ,  at  time  t  =•  O  need  be  estimated. 

It  has  already  beer?  mentioned  that  both  theory  and  experiment 

indicate  that  an  observation  interval  covering  the  main  lobe  and  two  sidelobes 

(on  each  side)  of  the  ~ ^2  irXjt  ^ —  function  should  suffice  for  the  current 

investigation.  The  main  lobe  of  this  function  has  a  width  of  l/yf  and  each 

of  the  sidelobes  has  a  width  1 / ZW  so  that  this  observation  interval  has  a 

duration  T  =  ,  With  an  RF  bandwidth  B  the  RF  signal  can  be 

reproduced  from  samples  of  the  in-phase  and  quadrature  components  spaced 

at  intervals  A  -  1/B  seconds  apart.  Thus,  placing  one  sample  at  t  -  O 

3 

there  are  TB+1  =  3—  +i  =  3  M-H  =  L  samples  of  the  in-phase 

and  3  M+l  samples  of  the  quadrature  component  required  to  adequately 

$ 

describe  the  RF  waveform  over  this  interval.  The  RF  waveform  can  then  be 

This  statement  is  not  exact  because  a  signal  cannot  be  strictly  limited 
in  both  time  and  frequency.  For  large  bandwidth  time  products  the  error 
becomes  negligible. 


represented  as  a  point  in  a  ZL  dimensional  Cartesian  coordinate  system. 
In  this  waveform  space  the  noise  has  a  spherically  symmetric  Gaussian  dis¬ 
tribution  with  zero  mean.  Changing  the  amplitude  of  a  (o)  causes  the  signal 
point  to  trace  a  convoluted  liue  through  this  space,  but  this  signal  graph  is 
nowhere  tightly  packed  into  the  space.  In  the  estimation  procedure  the 
continuous  distribution  p(a )  is  approximated  with  a  discrete  distribution. 
With  the  adjacent  values  of  a  (o)  chosen  such  that  the  increments  in  phase 
angle,  A<p  =  a(&/  are  less  than  . 4  radians,  in  order  to  insure  a 

sufficiently  dense  sampling  of  the  RF  signal  space  along  the  signal  graph. 
The  coordinates  of  the  corresponding  set  of  points  in  the  signal  space  are 
then  computed  and  the  likelihood  function  p  ^  }q)  is  evaluated  at  these 
points  in  accordance  with 


M HitM  *  K  CM  Eo5'*  A*}  2} 


= K  -  ww 

k 


(ii) 


Where  d(a )  is  the  distance  between  the  transmitted  waveform  er  M 
resulting  from  the  modulation  a(t),  and  the  received  waveform  ? %(£)  The 
likelihood  function  is  zero  at  any  point  in  the  signal  space  which  does  not  lie 
on  the  signal  graph.  The  important  concept  is  that  every  waveform  limited 
to  the  RF  band  of  width  8  Hz  centered  on  frequency  and 

duration  T  can  be  represented  in  this  signal  space,  but  that  possible 
transmitted  signals  are  constrained  to  lie  on  the  signal  graph.  By  restricting 
our  attention  to  this  graph  the  magnitude  of  the  problem  has  therefore  been 
greatly  reduced. 

With  the  likelihood  function  defined  along  the  signal  graph  the 
estimates  derived  in  accordance  with  the  three  criteria  described  earlier, 
can  be  determined. 


s 

9 


I 


As  mentioned  previously,  the  number  of  signal  points  was  increased 
at  high  (S/N).  in  order  to  keep  the  effects  of  the  quantization  negligible  in 
comparison  ^vith  the  errors  due  to  noise. 
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It  is  interesting  to  observe  that  the  maximum  likelihood  estimate 
corresponds  simply  to  the  smallest  value  of  (d)  and  hence  does  not 
require  evaluation  of  -f)  (B .  J  q)  or  knowledge  of  3  This  comment 
also,  applies  to  MAP  estimation  with  jp(o)  constant  as  we  have  assumed 
here.  The  MMSE  estimate,  however,  requires  the  evaluation  of 
gXjpjr  fa;]  and  therefore  knowledge  of  N9  &  .  The  bandwidth  3 

used  iu  this  simulation  was  chosen  by  a  conservative  application  of  the  so- 
called  Carson's  rule 


Zif  \cJt  /max 


) 


with  f  -  fia  (o) 


sin  wt 
ZirWt 


tv#-  t*c*l **"&&*} 


The  function  ------  . and  its  derivatives  have  been  tabulated, 

its  first  derivative  attains  a  maximum  value  of  .43618  at  x  =  -  119.5°. 

Since  use  of  a  larger  bandwidth  than  required  can  result  only  in 
improved  estimates  but  at  the  expense  of  increased  computation,  we  have 
for  the  purposes  of  the  application  of  Carson's  rule  assumed  W/3 

(i.  e. ,  we  have  replaced  'a'  by  its  maximum  value  of  unity  and  used  1.0 
instead  of  .  43618).  So  that  8  =  SW  (ji+l) land  the  bandwidth  expansion 
factor  AJ  «  Z(jS  +  l)  .  For  convenience  in  the  actual  computations  M  =10 
was  used  for  all  ~  4,  and  M  =20  for  =  8. 
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Conclusion 


The  performance  of  a  phase  modulated  system  was  investigated  by 
means  of  a  digital  computer.  For  the  case  of  a  simplified  modulation 
process  the  computer  evaluation  of  the  performance  of  estimators  (receivers) 
optimized  in  accordance  with  the  MMSE  and  MAP  criteria  was  evaluated. 

This  method  readily  permitted  investigation  of  the  behavior  of  these 
estimators  in  and  below  the  threshold  region,  where  analytic  investigations 
are  very  difficult. 

In  applying  the  results  obtained  one  should  particularly  bear  in  mind 
that  the  curves  are  upper  bounds  to  the  performance  obtainable  with  non- 
realtime  estimators  and  that  the  modulation  was  uniformly  distributed  in 
amplitude.  It  would  be  very  desirable  to  extend  the  investigation  to 
Gaussianly  distributed  modulation  processes,  where  a  comparison  with 
analytically  derived  results  (Chapters  II,  HI)  and  experimental  results 
(Chapter  V)  could  be  more  easily  made.  Although  no  difficulty  is  apparent 
in  modifying  the  computer  program  to  handle  this  case,  there  was  insuf¬ 
ficient  time  available  to  undertake  these  further  investigations. 
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APPENDIX  IV  -A 
COMPUTER  PROGRAM 

«*&**********«*****  ************************************  ****<:**»».»•• 


DECK  MAKE.  OEHOA 

MACHINE.  IBM  7044 

SOURCE  LANGUAGE'.'  FORTRAN  IV 


purpose  . .  . . 

HONTE  CARLO  EVALUATION  OF  THE  PERFORMANCE  OF  PM  ANGLE  MODULATION 
SYSTEMS 


DESCRIPTION 
NSNR 
NATS  ‘ 
NRNS 
NTTS 
NTMS 


NST  ART 


BETA 
BEE  ‘ 
SNRIOB 
Jl 


DESCRIPTION 

S/N 

( S/NIDB 
A  ( 0 1 
RNS 
'  '  HIE 
MMSE 
MVO 
MV02 
SIG02 
MSE 

PROS  ' 
AVE.HSE 


OF  INPUT  PARAMETERS 

-  NUMBER  OF  SIGNAL-T0-N01 SE  RATIOS 

-'number  OF  Values  OF  'Ao'  Used 

-  NUMBER  OF  STATISTICAL  TRIALS 

-  NUMBER  OF  CANDIDATE  TRANSMITTED  SIGNALS 

-  NUMBER  OF  TIME  SAMPLES  ON  EACH  SIOE  OF  CENTRAL 
SAHPLE. TOTAL  NUMBER  OF  TIHE  SAMPLES  FOR  THE'  IN  PHASE 
COMPONENT  IS  2INTMSIU. TOTAL  NUMBER  DF  TIME  SAMPLES 

- m'  W' QGAWfATi/SE'  COMPONENT  I  $ '2<  NtMSf*l - 

-  TWELVE  DIGIT  OCTAL  INTEGER.  INTUL  STATE  OF  RANDOM 
NUMBER  GENERATOR 

-  MODULATION  INDEX 
BANDWIDTH  EXPANSION  FACTOR 

-  SIGNAL-TO-NOISE  RATIO  IN  DECIBELS 

iwx-iwc muG  yffs in m  of  transmitted  $  reuse - 

IN  ARRAY  OF  CANOIOATE  SIGNALS 

-  AMPLITUDE"!)?  TRANSMITTED  MODULATION 

-  PRIOR  PROBABILITY  OF  AO 

-  AMPLITUDE  OF  CANOIOATE  SIGNAL 
_ -  PRlORf^qBABILITY  OP  .AZ 

OF  SYMBOLS  USED  IN  PRINTOUT 

-  SIGNAL-TO-NOISE  RATIO 

-  SIGNAL-TO-NOISE  RATIO  IN  DECIBELS 

-  AMPLITUDE  OP  TRANSMITTED  MODULATION 

-  NUMBER  OF  TRIAL 
-'fiff5UHUfr_A" POSTERIOR l  ’ESTIMATE 

-  MINIMUM  MEAN  SQUARE  ERROR  ESTIMATE 

-  SAMPLE  MEAN  ESTIMATE 

-  SAMPLE  MEAN  SQUARE  ESTIMATE 

-  SAHPLE  VARIANCE  OF  ESTIMATES 

-  MEAN  SQUARE  ERROR 

•MOB'SBnrTV  OF' CORRECT  IDENTIFICATION  OF  A<<5)  'ITT ‘MAT* ' 
MODE 

-WEIGHTED  AVERAGE  MSE 


REMARKS  . .  '  "  ■ 

PROGRAM^PROOUCES^PUNCHED^CARO^OUTPUT. FIRST  CARD  IDENTIFIES  OUTPUT. 

SUBPROGRAMS  REOOIREO  -  -  - 

DVOCHK  -  CAL  SYSTEM  LIBRARY  SUBPROGRAM  CU  0032. TESTS  FOR  A 

-  - TERD'  OTVISOR  '  ’  - - - - - 

GRNOROtNI  -CAL  SYSTEM  LIBRARY  SUBPROGRAM  CU  0024. SETS  INITIAL _ 

_ _ STATE  OF  GAUSSIAN  RANDOM  NUMBER  GENERATOR  TO  THE 

VALUE  N .  . . 

_ _ GRNTP(XtN)-CAL  SYSTEM  LIBRARY  SUBPROGRAM  CU  0024. GENERATES  N 

FSEUDO  RANDOM  GAUSSIAN  DEV  I ATE SI FLOATING  POINT,ZERO 
_ _ MEAN, UNIT  VARIANCE!  IN  LOCATIONS  XU),....XIN( _ 

•*****************$************4«i*****«!******###*****.*#*#<i*$******* 
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SSDEKOA 


01T5ENS t bM  AoT4)  ,PAOI4)  ,Q1(  2), 02(2/  ,  '  Q3'(~2»  *Q4(2i  ,05(27,06(2)  » 

lQ7(2),Q8m»Q9m,Qj_0j2),Qll(2),JZ(4)  ,SEST(2)  ,SEST2<2) , 

2SiNCX( 30) «  ERt  6 1  )VEN ( 6 1) , A (2) , AZ (4 1 ,47 , Z <  4  f f  , ET 161,41, 4) , 

3RH02  ( 2 ) ,  012  ( 2itSiNR  I  OB  i  25 ) ,  P  A 1  4 1 , 4  ) 

COMPLEX 'ETiER.ENtlHAGiDTFF  '  . 

DATA  SS/6HSS0ATA/ 

CALL  DVDCHM 1 )  . .  '  . . 

PUNCH  302,SS_ _ 

302  F0RMATI72XTA6) 

500  REAQ(5, 1)  NSNR,NATS,NRNS9NT?S,NTHS,NSTART 

T'FoTMAf  *1 5110,  012) .  . . 

REAO( 5* 12)  0ETA.8EF 

fl“ FSKM’St  ise’i  o.  ol  “  . - 

READ  (5,12)  (  SNRJDBJ  I  )  ,  l=l»NSNRi 
■'  'REA0(5',ir  (J4ClT,'i*T,NATS) 

READ  (5,12)  (A0(  I  )_*  r=i,NATS) 

'REA0T(5,12) '(PAOlij,  i“i,~NATSr 
00  400  J=1,NATS 

. REAS  r5Tf2f  •(AZff.Jirin.NTTSr  .  " 

READ  (5,72)  ( PA( 1 , J ) , 1=1,NTTS) 

72  FORHAt  ( l6F5iO) ' 

400  CONTINUE 

HR  I T  E  ( 6 , 2 )  . .  “  '  . 

2  FORMAT  ! 53H1PERF0RMANCE  OF  ANGLE  MODULATED  SIGNALS  -  J. LAW70N/SS/ ) 

WRITE"!  6, 3  f  NSNR  fN ATS , NRNS , NT T S,NTMSV NSTART . 

3  FORHAT  ( 6H0NSNR=» 1 3, 2X, 5HNATS*  ,I3,2X,5HNRNS=,I3,2X,5HNTTS=,I3,2X, 

‘  1 5 H NT M S  *7'1 3“, "2 X  ,'  7h N  STa R  T  = ,  OlTF  "  "  " 

WRITE  (6,13)  BETA, BEF 

13  F0RMAT'T6tfdEflErA= , F77J72X, 4HS£F=»F  7. 2 )  '  . . . 

WRITE  (6,14)  (SNRI0B(I),I=1,NSNR) 

■■~I4  F0Rfl«n7H(J^RIWIS7T>??71T'  “ . . . ~  “ - 

WRITE(6,75)  (JZ(I), 1*1, NATS) 

‘  75  F0RMAT'(3H0JZ/1X,10I4) .  "  . 

WRITE  (6,70)  (AO(I), 1=1, NATS) 

■"7(T  FORMAT"  (4H0a'o=»6e20. 8) .  . 

WRITE  (6,344)  ( PAO( I ) , 1=1, NATS) 

'”344"  F'0ffflATT5H-5'PX(Ji'l'g:eT0T8T  - - - - - 

DO  300  4=1, NATS 

WRITE  (6, 73')  (A2n7Jr,T  =  fiTJrT5)'  *'  . 

73  FORMAT  I 3H0AZ/I IX, 16F8. 3) ) 

'  WRITE  T6;r4T  (PAH, ’3),  I  =  l',NTrS)  . 

74  FORMAT  (3H0PA/( 1X,16F8.4)) 

'  300“ CORTTflUI - * -  - - - - - 

PI=3. 1415926536 

fnrNS=floATiNRns) .  "  “ 

IMAG«CMPLX(0.0, 1,0) 

'  NIQS=24NTfCS*r"'  "  '  . . .  '  . . 

NGRN=2*NI0S 

■  FNT f  S*FL 0 AT(  NT f  S  )  "  .  . . 

DO  10  I«1,NTMS 

- fr*T2.omo*Tm  tme - 

IF  (R.EQ.AINT(R))  GO  TO  11 

X«PI*R  '  ‘  . . .  “  . . . . 

SiNCX(I)»SIN(X)/X 

GO  TO  l(j  “  . . . . . . 

11  SINCXU)=O.G 

— fO  CONT  INOF - - - - - 


00  23  NTS*1,NATS 

t»  "20  J-lttfTrs‘  ‘  ■"  "  — 

NAD 0*0 

00  2 1  NR£P*'l,2 
00  22  I*1»NTHS 

. RSTvmoo — -  - 

PHl»SETA*AZI J,NTSI*SINCX( I ) 

"  Eti»U3,fiTSJiC0S<PHl  )-rftA'G*$t'NJP'Hi') 

22  CONTINUE 
NADO=NTMS 

21  CONTINUE 

- VfdVBETX«XZ13^iTSr -  -  * 

ETINIQS  »J»NTS>=COSiPH! )-IMAG*SIN ( PHI » 

20  CONTINUE  ’ 

23  CONTINUE 

i'P  (NSTART:ne;0)  CALL  GRNORG(N$TARrT) 

00  30  NR=l,NSNR 

- 00  SrWESTTZ - 

Q5INE)*0.0 

■  *  cfei  ne”i=o.o’ . 

Q8<  NE)*0.0 

62  COMTINUf .  . .  ' 

SNR* 10. 0**1  SNR  1 031 NR)/10«0) 

6n1"=-o.^75nr 

SIGHA*SQRT(8NZ) 

00  31  NTS* I, NATS  . . 

PR08>*0«0 

jat?,*jzCnts»'  . . . 

AZA*AOCNTS) 

- 'PAZ*PA0(NT51 - - - - * . 

QZ=PAZ*AZA 

’  “  '  WRITE  C6t  41  Sfjft’*  SMftt OBiNR  I  . 

4  FORMAT  C  5H1S/N=,F8.3,3X,8HS/NI0B)*,E1U3> 

••  AZA^&umsr  •'  ••• 

WRITE  16,51  AZA 

- 5  "FORMAT — ri¥OATOT=TFF.’JI - — . . 

WRITE  '6,6) 

6  FORMAT  (  1H'0,‘‘5x,3HRNS,5X;3HMLE’,19X,"4HMMSE) 

DO  40  NE=1 » 2 

sesriNEi^o.o  .  *  ■ 

SEST2CNE)=0.0 

WCONTTfTUF . . . . . . 

00  32  NT*1»NRNS 

•  'SALC  ■SRKTPIFfi'VNGMJ . . 

00  33  I* 1,N IQS 

.'•RTfRETnVJ'AT S7NT S f VS I GRAVEN (IT  “  " 

33  CONTINUE 


A1MAX=0.0 _ _ 

SA30K*0«0 

SPA20K»0«0 _  _ 

00  34  J*I,NT?S 

01S«0.0 _ _  _  _ _ 

“00  35  I*1,NIQS 
OIFF*ER«  D-ETC  I,J, NTS.I 
blS“OIStREAL(  DIFF  f*  *  2 ♦  A I MAG I OIF F |*  *  Z 
35  CONTINUE 

Z<j)*01S>BNZ  . 


34  CONTINUE 
ZMIN*Zl I) 

00  341  J*2,NTTS 


Tf  1  Z('j  ) . ltTzm in)  z«in*z(31  “ 


341  CONTINUE 


f 


! 


i 


00  342  J=i *NTTS 

PA10K*EXP(  ZMIN-ZI JJ.) _  ... 

IF  ■(PAlDK.'ofVAlMAX)  GO  TO  36 

GO  TO  37  _ _ _  ... 

36*  aihax=pa£ok 

_  _ _  .  - 

TTTJ2DKTpTlDK*PA  (  J  ,NT S ) 

SPA2DK=SPA2DK+PA2_DK 
S A30K=S A3DK ♦PA2DK*AZ ( j , Nf S I 

342  CONTINUE  . . . 

"  “  AC 1)=AZI JAljNTSI 

i~  UCU.EQ.AZAJ _  PROB=PROB+l.O 

‘  &{2 I=SA3DX/SPA20K 

WRITE  (6*7)  NT» (A(N£)»NE*1»2) 

7  FORMAT  <10X,l2,Fli.3, 1 IX, FI 1 .3/ ) 

DO  50  NE*1,2 

SESf (NE j=S£Sf (ME )*A(N£) 

SEST2(NE2  =  SEST2(N£)+ACNE)**2.  . 

50  CONTINUE . 

32  CONTINUE 

PR08=PR0'B/FNRNS 
DO  60  NE=1 ,  2 
i)l{NEi  =  SE'STTN£i/FNRNS 
Q2(NE)*S£ST2(NE J/FNRNS 
• — Tj^fric52TNf)-drtNr)'*'*2‘  *‘ ' ' 

Q4(NE)*(AZA-dl(NE)  )**2+«3(NE) 

‘  05 ( NE 1 =Q5C  NE  j  *QZ  *0 1 (NE )  " 

Q6C  NE )  =  Q6( NE )*PAZ*Q2( NE ) 

08 ( NE )  *08  ( NE  f*P  AZ'*04  C  NE ) 

60  CONTINUE 

-•  WRITE  T5;^2T  rOTTNrJ,NE=r,2T  ■ 

92  FORMAT  C10X.5HMV0  *,E12.3,E22.3> 

WRITE  (6,93)  (02JNE) »N£=i*2) 

93  FORMAT C9Xf6HMV02  =,E12.3,E22.3) 

WRITE  (6,94)  I03(NEIVNE=Ii2) 

94  FORMAT  (8X,7HS(G02  =, E12.3,E22.3) 

WRITE  16,951  (04TNEI;NE  =  I»2'J 

95  FORMAT  ( iOX,5HMSE  =,E12.3,E22.3» 

WRITE  ( 6, 2001  PRdB 

200  FORMAT  C9X,6HPR0B  =,EI2.3J 
IFIPROB.FO.l.O)  STOP 
31  CONTINUE 

00  90  NE=i,2 

RH02CNEI*  Q5(NE )**2/( ,3375*Q6(NE)  ) 

07 { NE ) *RH02 ( NE 1 70  V O-RHO? (NE  H  * 
012(NE)*10.0«ALOG10(RH02(NEn 
Q10(NE)  =  10.0*A1.0G10(Q7(NE) ) 

09 { NE ) *0.3375/0 8(NE) 

Oil ( NE)  =  10 ,0*AI  0G10(Q9(NE) ) 

90  CONTINUE 

WRITE  ( 6, 104 j  ( RH07C  NE ) »NE=1»  2 > 

104  FORMAT  (9X.6HRH02  *,E*2.3,E22.3> 

WRITE  (6,105)  ( 0121 NE ) »NE  =  l » 2 ) 

105  FORMAT  (11X,4H0B  =,E12.3,E22.3) 

WRITE  (6,96)  (QT(NE),NE*1,2) 

96  FORMAT  ( 2X, 13HRH02/ 1-RH02  =,£12.3,E22.3) 

•  WRITE  •{6,15?rT0I6TNE),NE*l,2"I 

WRITE  (6,97)  IQ8INE)»NE=1,2) 

97  FORMAT  15X,10HAVE.  MSE  *,E12.?,E22. )) 

WRITE(6,98)  (Q9(NE),NE*1,2) 

98  FORMAT" ( 2X’»  13H. 3375/AVMSE  *  ,E  12.3  ,E22. 3  ) 

WRITE  (6,105)  (Oll(NE)tNE=l,2) 

— «.h  •  mr"WTOBTH<rr;o'i<yiTr,"oio(  2  ),wruY&riT?  r 

301  FORMAT  ( F8. 1,4E 18, 3) 

30  CONTINUE 
GO  TO  500 
END  . . 
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APPENDIX  IV -B 

SUMMARY  OF  COMPUTED  RESULTS 


-  ■ar 

— crmrir  - 

C Ta 

- 

fc'Kl,** 

MUSE 

dk 

’  -O.VfM'oi 

uap 

dk 

-3.1/0*  U 

MUSE 

dk 

~n:v  *  ‘ 

fi 

-1.0 

-0.117#  02 

-0.102*  97 

•3.514#  51 

■j.  <017-31 

-f.o 

-S.042f  ei 

-0.575*  01 

*3.1 *1 #  31 

0.0/7#  6.9 

-2.0 

-0.0800  9> 

-6.106*  01 

-6,040*  «1J 

3.100#  9) 

ncr 

*  10 

“1.© 

-i.»!U'o> 

-0.147*  01 

-3. 7 14* • 51 

1.14/P  'll 

2.0 

*.  «.»  05 

0.105*  01 

•jnnr  or 

0.*24t  91 

3.140*  9| 

6.T4jr3l  * 

3.001 r  31 

1.»7»#  >1 
3.5l4»  01  " 
7.010#  01 

NT MS 

•  55 

♦.0 

0.2401  0> 

$.0 

0.5072  01 

C.0y5*  91 

3.5»yt  31 

3.-057  0| 

».o 

0.41 >{  01 

C.50Ct  01 

5.57XC  31 

9.tl*C  11 

no 

0.7072  Cl 

0.70)*  01 

0.731#  31 

0.0  43*  *1 

t.o 

0.402#  01 

0.425*  01 

0.4*0*  )! 

3.905#  0* 

— 

'  f.O 

— 0^077  "57 
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APPENDIX  IV -C 


LINEAR  ANALYSIS  OF  MMSE  ESTIMATION 
OF  PM  AND  FM  MODULATED  SIGNALS 

Phase  Modulation 

Comparison  of  Equation  (22)  Chapter  III  with  Equation  (4)  Chapter  IV 
shows  that  the  low  signal-to-noise  asymptote  and  the  high  signal-to-noise 
asymptote  coincide  in  the  limit  as  /3  approaches  zero.  (For  (S/N).  >>i, 

A  0“  *  ^ 

A0  ~  "7^7  )•  One  naturally  inquires  whether  the  attainable  performance 

is  for  all  signal-to-noise  ratios  given  by  these  asymptotes.  That  this  is 
indeed  so  is  demonstrated  below.  For  any  /3  the  mean-square  phase 
deviation  due  to  modulation  {&*)  =/32  CTa2 .  For  very  small  /3  the 

mean-square  phase  deviation  is  very  small  and  the  approximations 
AUi  0  ~  fowl  9  ~  6  and  ~  1  can  be  used.  In  the  limit  as 

y3  — *>o,  phase  modulation  thus  becomes  a  linear  modulation  in  quadrature 
to  the  unmodulated  carrier.  Let  the  modulation  "a"  have  a  flat  spectrum  ~ 
from  C-W  Hz  and  the  RF  noise  be  white  and  Gaussian  with  intensity  No  Watts /^z 
The  quadrature  component  of  the  received  RF  signal  is  then  given  by 
y3E0  cl  +  nPm  where  nz  is  a  white  Gaussian  random  process  of 

intensity  2N0  Watts /^z  (one-sided  spectrum).  The  minimum  mean-square 
error  in  estimating  a(t)  is  obtainable  by  use  of  a  quadrature  detector,  with 
gain  l/^Eg  to  recover  'a,  followed  by  an  optimum  (infinite  delay  Wiener) 
filter  to  separate  the  noise.  Let  a  represented  the  MMSE  estimate  of  "cl" 
and  Hoo  the  resulting  mean-square  error.  H«»  =  (fa  ~  &)*)  «  The 
minimization  of  the  mean-square  error  requires  (a  (a -a,))  —  0. 

The  relationship  between  the  correlation  coefficient  y°  and  the  normalized 
mean-square  error  ,  shown  in  the  sketch,  is  derived  below 


so  tha^ 


K  - 


i-y°* 


zw  (g,/?)2 

No 


ft: 

~N0W 


=/?&*). 


(C-7) 


It  is  important  to  realize  that  the  above  expression  is  correct  asymptotically 
as  /3  —*0,  at  all  values  of  (S/N)..  For  {S/N^  »  1  ,  A0  =  ~  ~0fe  ~h'‘ 

Comparison  with  Equation  (117)  Chapter  II  or  Equation  (4)  Chapter  IV  shows 
that  this  result,  Equation  (C-7),  is  also  asymptotically  valid  for  all  /?  as 
(S/N).  — *  00 .  Comparison  with  Equation  (22)  Chapter  III  shows  agreement 

for  /3  — ►  0  and  (s/n);  — *■  0 . 


Frequency  Modulation 


The  performance  of  an  FM  system  can  also  be  determined  by  linear 
analysis  provided  that  G~£t  the  variance  of  the  phase  deviation  due  to 
modulation  is  sufficiently  small?  In  the  frequency  modulation  case  G~ez 
depends  on  both  the  modulation  index  /3  and  the  spectr am  of  Sa(c^)  of  the 
modulation,  because  with  FM  the  phase  deviation  is  inversely  proportional 
to  the  modulating  frequency.  (We  assume  as  before  that  the  modulation  has 
zero  mean,  {a)  =  0,  and  unity  variance, 

c/  -£**  #  - '  • ) 

Consider  a  bandpass  spectrum 


$  (p)  =  i  0>z~Co1  ^  *  1^1 

L  0  ,  elsewhere 


(C-8) 


6  =  /?  /  dt 


(C-9) 


Sqfa>) 

Co3 


f  AZK 


0  ,  elsewhere 


(C-10) 


'For  (S/N).  sufficiently  large  so  that  the  in-phase  component  of  the 


noise  can  be  neglected,  a  linear  analysis  of  FM  can  be  carried  through  for 


all  (Jq 1  ia  the  same  manner  as  for  PM. 


-i 
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do> 

2.7T 


(C-ll) 


For  this  spectrum  the  linear  analysis  applies  provided  ~c3~c3J~  - 

The  received  phase  angle 


A/ 


/a(f)  t/f 


(C-12) 
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ft 


£E0 


*  a(i ) 


(C-13) 


■where  a  prime  denotes 


d(  ) 
dt 


?  The  mean- square  error  in  the  estimation  of  a(t)  at  the  output  of  a  Wiener 

filter  is  then 
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CO 


■  +  00 
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SnlM  S<x(to) 
S«^)+Sa(^) 


dCo 

■XTt 


(C-14) 


With  S*((o)  given  by  Equation  (C-8)  and  S  nj[^)  ~ 
(two-sided  spectrum) 
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Substituting  Equation  (C-15)  into  Equation  (C-5)  plots  of  vs  (S/N). 

were  prepared  over  the  range  -40  s  (S/N).  ^  50  db  and  for  all  combinations 

2.  >3^  ^ 

oi  the  parameters  =s  -- — — -  .3,1  and  -f5  ~  ~£jp  =  /0,  /os. 

UJ/  "j  f 

The  resulting  curves  are  reproduced  as  Figure  III-3. 


127 


-SZTft 


:  -'  iff 


Asymptotic  solutions  for  the  large  and  the  small  (S/N)^  cases  can  be 
obtained  by  limiting  operations  on  the  integrand  of  Equation  p-14),  or  by 
series  expansions  of  the  arc-tangent  function. 

We  thus  obtain 


Ag^ 


U,(P+1+  yF)  =  pT/fjy  (S^h  >  C5/N)l  »L  (C-16) 


3CTe 


co. 


-Aa  v 
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U0Z  O), 


( S/v)c-  =  <£  (S/N)L  ,  (5/N)- «  l 


(C-17) 


in  agreement  with  Equation  (27)  of  Chapter  III. 


i 
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APPENDIX.  IV -D 


SENSITIVITY  OF  /mse“  /  AND  A0  ORDINATES 
OF  FIGURE  IV-.1 ,  TV'V2,,  T.Q' EXPERIMENTAL  ERRORS 

?  /  .  ,  ■ 

The  sample  mean- squads: 6  error  obtained  experimentally  will  be  an 
inexact  estimate  of  the  meaji-square  error.  In  plotting  A0  Jb  (s/N)jdb 
the  sensitivity  of  A0dt  tc/errbrs  in  the  value  of  the  mean-square  error 
goes  to  infinity  as  ^S/N}.ygofes  to  zero,  i.e. ,  as  the  mean-square  error 
approaches  0”aZ:  Tb;4s, 


A  =  -JLj. _Lz 
0 


(0-1) 


where  h  represents  the  minimum  mean-square  error  normalized  with 

respect  to  CTi.  Tas  discussed  in  Appendix  IV-C. 


A0(Jb  4 


A  Aait 
Ah  '• 
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-JO 


(0-2) 


(0-3) 


j. 

=  -fj-Aaik...  _1 —  =  -  -i-  — ►-<»  as  h~>iJ(h»-+o) 


(0-4) 


(0-5) 


On  theiother/hand,  plots  of  (~^f) Jb  ^  (s/n)i  Jb  are  not  subject  to  this 
difficulty,  jhusy 


j/fes  ; 

a(/Ms&7A.i 


f  ^f-ioh)  -  -hZ-*-l  as  h-~l,(hJit-*o) 


(0-6) 


Because  ’the.  above  dependence,  plots  of  the  experimentally  obtained 
(“Sftv'-  $$  S/N)j  Jb'  Figure  IV-1  show  less  scatter  in  the  low  (S/N). 
regipri  thin:  th'^  corresponding  plots  of  A0  jy,  (s/n).  ^  Figure  IV-2. 


,  ;  V 
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V.  COMPUTER  SIMULATION  OF  FM  DEMODULATION; 

WITH  EMPHASIS  ON  PLL  OPERATION 
IN  THE  THRESHOLD  REGION 

1 .  Introduction  ! 

The  relationship  of  phase^locked  loop  (PLL)  FM  demodulator  design  to 

the  theory  of  maximum  a  posteriori  (MAP)  estimation  of  FM  signals  is 

described  and  the  threshold  Characteristic  of  a  PLL  system  based  on  our 

f  ll5^  I 

previous  MAP  analysis1-  J  ^is  evaluated  by  means  of  a  hybrid  computer  simu¬ 
lation.  The  results  are  cc/mpared  against  the  well  established  performance 
of  limiter -discriminator  Receivers,  other  PLL  evaluations,  and  the  theoretical 

work  on  the  limit  to  threshold  extension  as  developed  by  Akima.  ^ 

! 

\ 

It  is  the  intent  of /this  simulation  to  specify  and  evaluate  a  physically 
realizable  demodulator  that  will  give,  with  some  reasonable  criteria,  the 

t 

best  possible  estimat/h  of  the  modulation  in  a  system  in  which  the  carrier  is 
phase  modulate; cl  by  ^ome-function  of  the  information  to  be  transmitted.  Tn 

t 

the  generalized  ahg^’e  modulation  system  shown  i.i  Figure  V-l,  the  linear 
operator  would 'be  j.  constant  multiplier  for  a  phase  modulation  system, 
whereas  an  FM  system  would  require  that  this  operator  be  an  integrator. 

I  i  * 


I  Figure  1-1 

While  much  q/f  what  follows  is  extendable  to  any  linear  operator,  the  work 
will  be  specialized  to  the  design  and  performance  evaluation  of  FM  demodu¬ 
lators.  I 


Early  work  in  this  field  by  Youla  (Reference  [3])  introduced  the  term 
"maximum likelihood" ,  which,  although  somewhat  of  a  misnomer,  was  used 
in  our  previous  work  (Reference  [l]).  As  discussed  in  greater  detail  in 
Chapter  the  term  maximum  a  posterior  (MAP)  is  more  appropriate  and 
will  henc.efprth.be  used  in  this  Chapter. 
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If  a(t)  is  the  modulating  signal  (i.  e\.  ,  the  information  to  be  transmitted) 
the  instantaneous  angular  frequency  of  the\transjnitted  signal  may  be  written 

&>(t)  =  +  /3a(t)  \  (1) 

\ 

\ 

and  the  resulting  phase  is  \ 


\ 

<f(t)  -  fU?)  dr  =  Co0t  +/3  pal'y)  dr 


Thus,  the  FM  signal  is  of  the  form 


l 

eT(t)  =£„^i  \ 


The  most  obvious  approach  to  extracting  the  modulation  signal,  a(  ) 
from  the  received  signal  is  to  perform  essentially  the  inverse  of  the  modulation 
process.  That  is,  the  demodulator  would  generate  an  output  proportional  to 
the  instantaneous  frequency  (or  rate  of  change  of  phase)  of\the  received  signal. 
This  is  precisely  what  the  limiter -discriminator  or  zero-crossing  demodu¬ 
lator  is  designed  to  do.  The  performance  of  the  discriminator  type  demodu¬ 
lator  has  been  quite  well  established  from  both  theoretical  analyses  and 
empirical  results.  At  sufficiently  high  carrier-to-noise  power  ratios,  the 
signal-to-noise  ratio  at  the  demodulator  output  is  linearly  proportional  to  the 
input  carrier-to-noise  ratio.  However,  a  marked  threshold  i^|  observed  when 
the  carrier -to-total  noise  power  at  the  input  to  the  discriminator  is  approxi¬ 
mately  10-12  db;  below  threshold  the  output  signal-to-noise  ratio  decreases 
rapidly.  This  effect  is  predicted  by  the  work  of  Shannon  which  ihows  that  all 
bandwidth  expansion  systems  which  attempt  to  achieve  an  improved  signal-to- 
noice  characteristic  by  fully  utilizing  a  greater  bandwidth  will  exhibit  a 
threshold  characteristic.  Above  threshold  the  output  signal-to-noise  ratio 
can  be  increased  at  the  expense  of  increased  bandwidth;  however,!^  this  results 
in  an  increase  in  the  total  noise  power  at  the  input  to  the  discriminator  and 

the  threshold  occurs  at  a  proportionately  higher  carrier  level.  ' 

« 

A  number  of  demodulation  techniques  for  improving  the  threshold 
performance  of  FM  systems  have  been  proposed  and  some  of  these)  techniques 
have  been  shown  experimentally  to  exhibit  substantially  better  performance 
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than  the  conventional  discriminator,  However,  it  should  not  be  surprising 
that  the  discriminator  (designed  simply  to  be  the  inverse  of  the  modulation 
process)  is  not  the  optimum  FM  demodulator,  because  consideration  has  not 
been  given  to  the  a  priori  knowledge  of  the  statistics  of  the  modulation  or  of 
the  additive  noise. 

i 

2.  Maximum  A  Posteriori /Reception  of  FM  Signals 

■l 

The  basic  demodulation  problem  is  to  obtain  the  best  estimate  of  the 
modulation  signal  from  an  observation  of  the  received  signal  plus  noise 
utilizing  all  available  statistical  data.  In  a  previous  work  ^  application  of 
statistical  estimation  theory  yielded  an  expression  for  the  solution  to  the  FM 
demodulation  problem/which  provides  the  a  posteriori  (after  utilization  of 
all  available  data?)  moat  probable  estimate  of  the  modulating  signal.  The 
theory  of  maximum  a  posteriori  (MAP)  demodulation  was  first  developed  by 
Youla^  and  applied  to'  amplitude  and  phase  modulated  systems.  In  our 
previous  effort  the  application  of  this  theory  to  frequency  modulated  systems 
was  developed  and'the  salient  results  of  this  work  are  summarized  below. 

The  aim  of/this  approach  was  to  define  a  demodulator,  which  after 
having  observed/the  received  signal  over  some  interval,  T,  produces  as  its 
output  a  function  £fe7~) ,  which  is  the  MAP  estimate  of  the  transmitted 
modulation,  d(T). 

For  FMj  the  received  signal  is 

e#(i\  =  jusn  '\a>0 1  "  <*(«)  du+&^  t  n(t),  t-r*  (4) 

t-T 

where  the  signal  is  observed  over  the  preceding  T  seconds.  The  MAP 
estimator  chooses  d (T}T)  such  that  is  maximized. 

It' is  Assumed  that  both  the  intelligence,  a(t),  and  the  noise,  n(t)  are 
zero  mean -Gaus sian  processes.  It  is  further  assumed  that  a(t)  is  stationary 
and  t,hat  thk  additive  noise  is  white  and  Gaussian,  with  a  noise  power  density 
of  A/0  watts  per  Hz  (one-sided  spectrum).  Then,  considering  the  infinite 
delay-case,  the- MAP  formulation  leads  to  the  following  integral  equation 
whose  sjoihfipr?  is  the  desired  estimate.  (See  equation  (26)  in  Chapter  II  of 
R efer'enc^  [l], ) 


! 
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OO  r-  /« X 

3.(T}co)  ^  EJk.  J  h(z-x)\E0J&ri/3j  [a(tt)-a(it,«>)]  d 


u 


+  r?c(x)xua/2f  a(tt,<*>)du  -ns(x)  >«/3  [*$(11,00  )du]  dx 

-  00  ~oc?  J 


Let  t?; (X)  =  t2c  x**J.  0(x)  -«s  &(X) 

where  0  (x,00)  =  /3  f  a(a, 00)  du 

J-oo 

Since  tlc  and  nv-  are  independent  white  Gaussian  noise  processes  of  intensity 
ZN0  ,  tlfo)  is  also  a  white  Gaussian  noise  of  intensity  ZNn  (single-sided 
spectrum).  The  integral  equation  to  be  solved  can  now  be  written 

2  (r,°°  )  =  -jjf- fEo  ^n/3£^[a(u)-a(u,oo)}du+  n,(x) ]dx  .  (6) 

It  is  noted  that  the  above  equation  is  in  the  form  of  a  convolution  integral. 
From  linear  network  theory  it  is  known  that  the  output  of  a  linear  filter  is 
obtained  as  the  convolution  of  the  input  signal  and  the  impulse  response  of 
the  filter.  That  is,  if  ^(x)  is  the  input  to  a  linear  filter  having  an  impulse 
response  h(x),  the  output,  y(z)  is  given  by 

y(r)  =rr°°h^_^  (7) 

*'"30 

Thus,  one  may  think  of  the  terms  within  the  square  bracket  of  Equation  (6) 
as  being  the  input  to.  a  filter  whose  impulse  response  is  h(7)  and  whose 
output  would  be  a (V,T). 

Letting  $(x)  -ftf  ^(u)du  and  &( X,00)  (u>  °°)  ,  Equation  (6) 

may  be  represented  by  the  following  model  for  an  infinite  delay  MAP  FM 
demodulator . 
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Figure  1-2  /  MODEL  FOR  MAXIMUM  LIKELIHOOD  FM  DEMODULATOR 


The  model  in  Figure  V-2  is  of  the  same  form  as  the  low  frequency  models 
which  have  frequently  been  employed  to  represent  phase-locked  loop  receivers. 
A  significant  result  presented  in  Chapter  III  of  Reference  [4],  v/hich  relates 
the  design  of  a  PLL'loop  structure  to  the  results  of  the  MAP  analysis,  shows 
that  if  the  model  in.  Figure  V-2  is  linearized  (i.  e.  ,  if  the  sine  operator  is 
replaced  by  a  unit^f  gain),  the  loop  filter  as  required  for  the  MAP  model  is 
identical  to  the  filter  in  the  infinite  delay  phase-locked  loop  model.  In  the 

i 

case  of  the  phase-locked  loop,  the  optimal  filter  is  obtained  by  applying  linear 
least  mean-square  filter  theory  to  a  linearized  version  of  the  loop.  In  this 
case  the  filter  is'  known  to  be  optimum  in  the  MMSE  sense  only  when  the 
signal-to-noise  ^s  sufficiently  high  so  that  the  linearized  model  is  valid. 

t 

However,  from  the  MAP  model,  this  same  filter  is  also  specified  for  MAP 

estimation  wheiji  the  sinusoidal  operator  is  retained  in  the  model.  That  is, 

i  .• 

it  has  been  shown  that  an  FM  demodulator  using  a  phase-locked  loop  structure 
containing  this' nonrealizable  filter  would  perform  the  operation  specified  for 

i  .  • 

the  infinite -dej'lay  MAP  demodulator.  This  equivalence  is  valid  for  all  modu¬ 
lation  spectra  and  at  all  carrier -to-noise  ratios.  It  must  be  emphasized  that 

i 

the  resulting  structure  is  nonrealizable.  This  nonrealizable  structure,  how¬ 
ever,  suggests  the  design  of  realizable  demodulators  which  hopefully  would 
yield  performance  close  to  that  of  an  optimum  realizable  demodulator. 
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The  analysis  presented  in  Chapter  H^of  this  report  shows  that  the  MAP 
estimate  agrees  with  the  series  expansion  »for  the  MMSE  estimate  up  to  the 
first  two  terms.  The  empirical  investigations  reported  in  Chapter  IV  show 

close  agreement  of  the  MAP  and  MMSE  esfirriates  above  and  into  the  threshold 

\ 

region. 

In  a  realizable  phase-locked  loop,  the  impulse  response  h[x)  must  be 
zero  for  X  <0.  Therefore,  a  realizable  phase-locked  loop  would  have  a 
transfer  function  which  differs  from  that  required  of  an  infinite  delay  MAP 
receiver.  This  difference  in  response  could,  in  principle,  be  corrected  in  a 
linearized  model  by  following  the  phase -locked  loop  b\y  a  compensating  filter 
having  the  required  transfer  function.  However,  it  is.mot  clear  that  this 
would  represent  the  optimum  configuration  for  the  nonlinear  model  at  all 

l 

carrier-tc-noise  ratios  and  thereby  represent  the  system  with  the  best 
threshold  characteristic. 

Similarly,  referring  to  the  MAP  model,  it  has  not  been 
established  that  the  realizable  model  in  which  the  filter  is  'designed  as  a 
zero-delay  least  mean-square  filter  will  represent  the  best,  system  at  the 
lower  carrier-to-noise  ratios  where  the  nonlinearity  due  to  ;the  sine  operator 
will  cause  a  distinct  threshold  characteristic.  However,  it  does  seem 
reasonable  to  accept  this  design  approach  as  an  approximation  to  a,  MAP 
demodulator  and  then  compare  the  resulting  performance  with^  other  systems. 
Because  it  is  very  difficult  to  determine  the  resulting  performance ; in  the 
threshold  region  by  analytical  means,  the  low  frequency  equivalent  circuit. 
Figure  V-3,  was  used  in  the  initial  phase  of  an  analog  computer  simulation 
and  is  representative  of  a  zero-delay  PLL  structure. 


n(t)  (equiv.  w.a.K.) 


Figure  X-3  LOW-FREQUENCY  EQUIVALENT  CIRCUIT  OF  PLL  FM  DEMODUlATOR 
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3.  The  Phase-Locked  Loop  Simulation 

The  computer  mechanization  of  the  low  frequency  equivalent  circuit  in 
Figure  V-3  was  straightforward.  Some  of  the  important  considerations 
regarding  selection  of  the  modulation  function,  definition  of  signal  band- 
widths,  synthesis  of  the  loop  stnd  post  loop  filters,  and  mechanization  of  the 
sinusoidal  nonlinearity  are  discussed  below. 


Both  random  and  sine  wave  modulating  signals,  a(t),  were  used  in  this 
simulation.  The  random  modulation  function  was  generated  by  passing  white 
Gaussian  noise  through  a  third  order  Butterworth  filter.  The  resulting  power 
spectrum  of  the  random  modulation  signal  is  given  by 


5a. 


(8) 


ID 


Our  earlier  theoretical  work1  1  on  the  MAP  estimator  for  FM  employed 
a  random  (Gaussian)  modulation  function  which,  for  mathematical  convenience 
corresponded  to  tljie  use  of  a  first  order  Butterworth  filter.  However,  it  was 
felt  that  a  modulation  spectrum  which  falls  off  at  this  rather  slow  rate  is  not 
representative  of  the  modulation  xisually  encountered  in  practice,  therefore 
a  sharper  cutoff  spectrum  was  chosen  for  this  simulation.  In  order  to  avoid 

I 

any  possible  error  due  to  D.  C.  drifts  in  the  associated  equipment,  the  low 
frequency  end  pf  the  modulation  spectrum  was  removed  by  means  of  a  high 
pass  filter.  The  frequency  of  the  sine  wave  modulation  was  chosen  equal  to 
the  corner  frequency,  UJC  ,  of  the  third  order  Butterworth  filter. 

With  eajch  form  of  modulation  it  is  necessary  to  establish  a  somewhat 
arbitrary,  although  quantitative,  value  for  the  RF  bandwidth  of  the  FM 
signal  and  thjen  define  a  "bandwidth  expansion  factor",  M,  which  is  the  ratio 
of  the  RF  b^dwidth  to  the  modulation  bandwidth.  A  useful  result  which 
relates  the  .Jrms  bandwidth  of  the  modulated  signal  to  the  rms  bandwidth  of 
the  modulating  signal  when  the  modulation  is  a  stationary  Gaussian  random 
process,  hjas  been  derived  by  Abramson.  ^  Abramson  finds  that  for  a 
frequency  irnodulated  wave  the  rms  bandwidth  (in  Hz)  of  the  modulated  wave 
is  1/2  7C  |imes  the  rms  frequency  deviation  in  radians/second.  The  band- 

t 

width  as  defined  by  Abramson  is  the  rms  bandwidth  referenced  about  the 
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carrier  frequency.  It  would  seem  that  aNjreasonable  measure  of  the  required 
RF  bandwidth  would  be  twice  the  rms  value  as  shown  in  the  Figure  below. 


Then  the  bandwidth  expansion  factor  (M)  is  defined  as  the  ratio  of 

twice  the  rms  bandwidth  of  the  modulated  wave  .to  the  rms  bandwidth  of  the 

V'.  k ' 

modulating  wave.  This  brings  the  definition  of  bandwidth  into  close  agreement 

I 

with  Carson's  rule.  Consider  a  carrier  the  frequency  of  which  is  sinusoidally 
deviated  with  a  maximum  deviation  of  A  f  Hz  at  a  modulating  frequency 
Carson's  rule,  which  defines  the  required  bandwidth  anddience  corresponds 
to  the  width  of  a  zonal  filter  passing  the  significant  energy  components  of  the 
modulated  signal,  yields, 


4  =  *4  ^4  (/*+f) 


At  large  values  of  /c  }  Bc  approaches  twice  the  value  of  thf*  peak  deviation. 
Defining  the  RF  bandwidth  as  twice  the  rms  bandwidth  yields  < 


=  ZAf^s 


=  izAf& 


-  is- 


which  agrees  with  Carson's  rule  in  the  limit  of  large  modulation!,  index 

recognizing  that  is  equal  to  the  rms  deviation  rather  than)  the  peak 

deviation.  When  Carson’s  rule  is  applied  to  other  than  sinusoidal  modulation, 

denotes  the  highest  frequency  component  in  the  modulation!  The 

bandwidth  expansion  factor  is  then  zf-HiSS*.  ■/■/') 

Fm  J  > 

When  sinusoidal  modulation  was  usedfor  the  testing  of  FM  systems,  the 
frequency  was  chosen  equal  to  the  3  db  frequency  of  the  Butferworth  filter 
and  the  bandwidth  expansion  factor  was  considered  to  be  given  by  ^  c  +  /). 
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Mechanization  of  the  requiredysinusoidal  nonlinearity  presented  the 
greatest  challenge,  and  was  successfully  achieved  through  the  use  of  a 
^txodified  ra.te  resolver  circuit  in^fohich  a  function  generator  provided  the 
basic  nonlinear  characteristic.  .  In  its  normal  application  the  input  to  the 
function  generator  must  be  restricted  to  values  between  -  180°;  however, 
this  range  was  extended  by  the  use  of  automatic  switching,  controlled  by 
digital  logic  in  the  hybrid  cqmputer.  This  permitted  operation  of  the  rate 
resolver  circuit  over  the  large  values  of  the  phase  error  encountered  in  the 
threshold  region.  In  mechanizing  the  sinusoidal  nonlinearity  with  the  rate 
resolver  circuit  configuration,  the  derivative  of  the  error  signal  is  required 
as  the  input,  and  therefore,  a(t)  and  §  (t)  may  be  used  as  inputs  to  the 
summing  amplifier.  T/hus>  the  two  integrators  in  Figure  V-3  could  be 
eliminated.  , 


The  filters  were  designed  such  that  the  loop  was  optimized  as  a 
minimum  mean-squ,are  error  system  using  the  linearized  model,  i.  e.  , 
setting  /m6(t)T6C£l-  First,  the  loop  filter,  F(s),  was  designed  to  minimize 
the  mean-square  phase  error  of  the  linearized  loop.  Then,  with  F(s) 

specified,  G(s)  was  chosen  to  minimize  the  mean-square  error  between  the 
modulation  function  a(t)  and  the  demodulator  output,  "a(t).  The  details  of  the 
synthesis  of  these  filters  and  the  evaluation  of  the  theoretical  mean-square 
error  for  the  linearized  system  are  given  in  Appendix  V-A. 

As  noted  previously,  the  low  frequency  equivalent  circuit  of  a  realizable 
zero-delay  PLL  can  be  made  equivalent  to  the  linearized  model  of  Figure  V-2 
by  incorporating  a  post  loop  filter  with  delay.  The  threshold  phenomenon  is 
associated  with  the  loop  characteristics  and  therefore,  the  design  of  the  post 
loop  filter  will  not  influence  the  threshold.  For  convenience  in  measuring 
the  MSE,  the  post  loop  filter  G(s)  was  designed  to  produce  the  MMSE  zero- 
delay  estimate  of  a(t).  However,  the  above -threshold  performance  will  be 
poorer  than'that  obtained  from  a  closer  approximation  to  the  infinite -delay 
model.  It  is  again  emphasized  that  the  primary  intent  of  this  simulation 
effort  was  jto  explore  the  threshold  characteristics  which  are  difficult  to 
obtain  analytically,  whereas  the  theoretical  performance  above  threshold  is 
obtainable  jby  straightforward  analytical  techniques,  viz  Chapers  II  and  IV. 
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4.  Experimental  Results 


The  initial  set  of  threshold  curves  obtained  in  this  simulation  were 

V 

made  with  random  modulation  and  bandwidthuexpansion  factors  of  20  and  80. 
Experimental  data  was  taken  with  and  without  Krhe  nonlinear  sine  operator  in 
the  loop.  This  permitted  a  useful  check  with  thv^  theoretical  evaluation  of 
the  above  threshold  mean-square  error.  The  theoretical  performance  of  the 
linearized  system  for  a  bandwidth  expansion  factor  of  80  is  shown  by  curve  1 
in  Figure  V-4.  The  corresponding  exp e r imental  data  from  the  simulation  of 
the  linearized  model  are  shown  as  curve  2.  Th'e  expSeiiniental  data  is  seen 


the  linearized  model  are  shown  as  curve  2.  T:h'e  experimental  data  is  seen 
to  be  in  excellent  agreement  with  the  computed  J&eorefcicai  performance.  The 
loop  filter  and  post  loop  filter  were  optimized  attach  yalue  of  input  carrier- 
to-noise  ratio  to  achieve  the  minimum  mean-squaire.  erior-  performance  of  the 

\  i  -  s, 

linearized  model.  These  same  filters  were  then  employed  when  the  nonlinear 
operator  was  placed  in  the  circuit  to  represent  the  actual  PX.L  system.  The 
threshold  characteristic  obtained  under  these  conditions  i^  shown  by  curve  3. 
It  seems  reasonable  that  the  performance  below  threshold  pould  be  improved 
somewhat  by  increasing  the  loop  gain  over  that  specified  by;  the  -linear  opti- 

[Wr 

mization.  This  is  suggested  by  the  quasi-linear  analysis1  J  .of  such  loops 
where  the  nonlinear  operator  is  replaced  by  an  equivalent  linear  gain.  The 
results  of  this  analysis  show  that  at  the  lower  carrier -tsqrnoise  ratios  where 
the  loop  phase  error  is  sufficient  to  reduce  the  gain  of  the  equivalent  linear 
operator  (which  is  made  equal  to  the  average  gain  of  the.  nonlinear  element), 
the  gain  of  the  filter  should  be  increased  to  compensate  for  this  decreased 
average  gain.  Gain  adjustments  were  made  on  an  empirical  ba^is  and  the 
threshold  characteristic  shown  by  curve  4  was  obtained.  I’his  curve,  shows 
that  an  improvement  of  approximately  1  db  in  (S/N),  at  which  threshold 

occurs  is  obtainable  by  this  technique.  { 

} 

i 

The  loop  threshold  characteristic  was  also  investigated,  in  $jie  absence 
of  a  modulation  signal  but  with  the  loop  designed  on  the  assumption  that  the 
modulation  is  present  and  optimized  in  the  same  manner  as  for  curve  4. 

Above  threshold,  where  the  linearized  model  of  the  system  is  valid,  the 
optimum  linear  filtering  results  in  a  minimum  mean-square  error,  which  is 

divided  between  a  distortion  term  due  to  the  filtering  action  of  the  loop  and  a 

1  1 

noise  term  due  to  additive  noise.  Therefore,  with  the  modulation  removed, 
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Figure  X-4  SIMULATION  OF  PLL  FM  DEMODULATOR 
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a  decrease  in  the  mean-square  errdr  viro^ld  be  expected.  (In  this  case  the 
MSE  =  <y£  since  <j^~0  ;  however,  for  purposes  of  comparison,  /MSE 
was  computed  as  if  Gg2  had  retained  its  iu^l  value.)  The  experimental  data 
is  plotted  in  curve  5  and  the  expected  reduction  in  the  mean-square  error 
above  threshold  is  observed.  With  this  particular  loop  design  the  experi- 

-  V 

mental  data  shows  virtually  no  change  in  the  injput  carrier-to-noise  ratio  at 

t. 

which  threshold  occurs  with  or  without  modulation* 

.  *  \ 

Curves  6  and  7  show  the  experimental  data  detained  with  random 
modulation  and  with  a  bandwidth  expansion  factor'  ofVjEO.  Here,  we  observe 

that  the  threshold  curve  for  the  linearly  optimized  system  is  much  more 

\ 

gradual  than  when  the  larger  bandwidth  expansion  factor  was»,  employed.  In 
fact,  this  curve  could  be  raised  even  further  by  empirical,  adjustment  of  the 

loop  gain  in  the  region  below  threshold.  \ 

\ 

It  might  be  noted  that  the  curves  above  thi  eshoid  do  riot  have  the  unity 
slope  which  usually  depict  the  performance  of  practical  demodulators.  The 
usual  curves  apply  to  fixed  filter  systems  and  consider  only  the  error  in 
reproduction  due  to  the  noise  which  decreases  inversely  wi^h  input  signal-to- 
noise  ratio.  The  error  caused  bv  distortion  of  the  modulation-function 

*  *  ,-»V 

(resulting  from  the  filtering  action  of  the  demodulation  systetn)  is  neglected. 
Ideally,  the  unity  slope  would  be  obtained  if  the  system  had  bjfeen  designed 
for  and  used  with  a  modulation  function  which  was  strictly  bandlimited. 

i 

However,  the  curves,  shown  in  Figure  V-4,  were  obtained  fipr  a  system 
with  the  modulation  spectrum  as  given  by  Equation  (8)  arid  the  (loop  filters 
were  adjusted  as  a  function  of  the  carrier-to-noise  ratio  in  ord^r  to  maintain 
the  minimum  mean- square  error  condition  taking  into  account  both  distortion 
and  noise  components.  That  is,  with  increasing  carrier-to-noisie  ratios,  the 
system  bandwidth  is  increased  to  accept  more  signal  energy;  otherwise  the 
distortion  term  would  soon  dominate  over  the  noise  term  and,  m  fact,  the 
ordinate  would  no  longer  rise  linearly  but  would  quickly  approach-, a  limit  set 

i 

by  the  distortion  term.  ; 

The  performance  of  the  PLL,  designed  for  this  random  modulatidn 
spectrum,  was  also  evaluated  when  sinusoidal  modulation  was,  useql..  In  this 

!■>  ^  J 

case,  the  required  RF  bandwidth  is  more  easily  defined  and  comparisons  can 


t  comparisons 
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be  made  with  generally,  accepted  FM  (discriminator)  curves  and  the  results  of 
other  reported  PLL  investigations  for  which  sinusoidal  modulation  was 
assumed  or  employed. 

In  our  simulation,  the  frequency  of  the  sinusoidal  modulation  was  set 
at  the  corner  frequency,  tt)c  ,  of  the  random  modulation  spectrum  given  by 
equation  (8).  The  bandwidth  Expansion  factor,  M,  was  defined  by  Carson's 
rule  to  be 

M  -  2  (/*■  + 1 ) 


It  was  observed  that  about  the  same  performance  above  threshold,  i.  e.  ,  about 
the  same  value  of  for  a  given  input  carrier-to-noise  ratio,  was 

obtained  when  the  mean-square  value  of  the  sinusoidal  modulating  signal  was 

jT  •>  x  ’ 

made  equal  to  the  mean- square  value  of  the  random  modulation  function. 

This  also  results  in  approximately  the  same  bandwidth  expansion  factor,  and 
therefore,  the  .system-.was  "optimized"  as  for  the  case  of  the  random  modu¬ 
lation  function  with  the  equivalent  bandwidth  expansion  factor.  The  filters 
were  identical  to  those  designed  for  use  with  the  random  modulation  function. 

{ 

The  threshold,  curve  in  Figure  V-5.  shows  the  performance  of  the  PLL 
system  when  a  sinusoidal  modulation  with  a  modulation  index  of  40  was 

employed.  The  loop  transfer  function  was  optimized  (with  the  empirically) 

/ 

established  opt^num  loop  gain  below  threshold)  as  described  previously. 

The  threfehcild  'is  seen  to  occur  at  an  (S/N).  of  approximately  24  db.  In 

<  ■  .  1 

this  case,  the  bandwidth  expansion  factor  is  approximately  82  and  the  curve 
would  have  to  be  shifted  19  db  to  the  left  if  the  abscissa  scale  indicated  the 
carrier-to-ndise  power  ratio  in  the  RF  bandwidth.  On  that  basis,  the  thresh¬ 
old  occurs  at/ 24-19  =  5  db  which  is  significantly  better  than  the  12  db  carrier- 

to-noise  ratijo .at  which  threshold  occurs  in  the  conventional  discriminator 

' 

type  demodulators 

Figures  vV -6,  V-7,  and  V-8  show  signal  recordings  obtained  during  the 
simulation  |Wh>,ch  resulted  in  the  threshold  curve  of  Figure  V-5.  These  three 
figur.e.8  shdw  typical  waveforms  taken  just  above  threshold,  at  threshold,  and 
below  the,  threshold  point,  respectively.  In  each  Figure,  curve  A  is  the 
moduiatioik  function,  a(t)  (sinusoidal  in  this  case)  and  is  the  input  to  the  low 

( '  i\ 

frequency  'equivalent  circuit  used  in  this  simulation.  Curve  B  is  the  estimate 
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gu re  1-7  RECORDINGS  FROM  SIMULATION  OF  PLL  FM  DEMODULATOR  AT  THRESHOLD 

(S/N)  j  =  24.5  db  ,  jU  =  W 


of  the  modulation  function  produced  at  the  o.itput  of  the  post  loop  filter  of 
Figure  V-3.  The  signal  at  the  output  of  the  wideband  PLL  is  shown  in  curve 
C.  This  is  the  signal  actually  fed  back  to  the  YCO  in  the  physical  system 
and  then  filtered  by  the  post  loop  filter  to  form  the  estimate  of  a(t).  Curve  E 
is  the  error  between  the  modulation  function  and  the  receiver  estimate,  i.e. , 
the  difference  between  curves  A  and  B.  Curve  E  shows  the  phase  error  signal 
at  the  input  to  the  nonlinear  operator  in  the  equivalent  circuit.  This  input  is 
maintained  through  the  digital  logic  within  -  7T  radians  and  discontinuities  in 
curve  E  indicate  the  number  and  direction  of  the  skipped  cycles.  Curve  F 
is  a  recording  of  the  equivalent  Gaussian  noise  introduced  into  the  loop  and 
this  same  sample  of  noise,  recorded  on  tape,  was  usdd  in  each  run. 

In  Figure  V-6  the  loop  was  operating  above  threshold  at  a  (S/N).  of 

26.5  db  (see  Figure  V-5).  The  estimate  is  seen  to  closely  reconstruct  the 
original  modulation  function  and  no  cycle  skipping  occurred  during  this  run. 

Figure  V-7  shows  waveforms  taken  at  threshold  with  the  (S/N).  set  at 

24.5  db.  The  estimate  of  the  modulation  (curve  B)  is  seen  to  be  somewhat 
more  noisy  than  in  the  previous  figure  although  it  still  appears  to  be  a 
reasonably  good  estimate  of  a(t)  most  of  the  time.  However^,  cycle  skipping 
occurred  during  this  run  and  two  instances  Where  loss  of  lock  occurred  are 
shown  near  the  beginning  and  the  end  of  the  short  sample  of  the,  recording 

t 

reproduced  in  Figure  V-7.  These  instances  of  cycle  skipping^ are  easily 
identified  oh  Curve  E  in  which  the  phase  error  is  abruptly  shifted  -2  IT 
radians  at  each  instant  that  the  actual  phase  error  exceeds  -  180°,  thus 
keeping  the  error  signal  recorded  on  Curve  E  within  the  bounds ^of  -  7T  radians. 

We  note  that,  the  system  skipped  one  cycle,  relocked  again^and  tracked 
along  until  two  2  7f  skips  occurred.  It  is  also  seen  that  these  strips  are 
coincident  with  the  occurrence  of  large  instantaneous  values  of  the  additive 
Gaussian  noise  shown  in  curve  5'.  The  resulting  "click"  phenomenon  is  also 
observed  in  the  demodulator  output  in  curve  C,  with  the  corresponding 
increase  in  the  error  as  shown  ir.  curve  D.  j 

Waveforms  resulting  from  operation  below  threshold  at  a  (S/jN).  of 
21.  5  db  are  .shown  in  Figure  V-8.  Both  single  and  multiple  skips  are  seen  to 
occur  and  the  mean-square  error  performance  has  been  degraded  jconsider- 
ably. 


5. 

.  ; .  ' 

The  low  frequency  fequivatlehi  circuit  of  a  PLL  as  used  thus  far  in  the 

/  '  ,  ''4  ’ 

simulation  was  modified  to  agree  with  the  loop  design  employed  in  a  study  of 
the  threshold  of  phas  e -locke.dlhops  at. the  Roly  technic  Institute  of  Brooklyn^?, 

In  their  investigation,  a  sinus oidal  modulation  function  was  assumed  and  data 

Y*  / 

was  obtained  with  and  without  modulation..  The; resulting  threshold  character¬ 
istic  was  considerably  better  than  the  generally  accepted  performance  of  a 
PLL  demodulator  and  it  was  concluded  that  a  wideband,  critically  damped 
loop  (as  opposed  to  a  narrow  band  loop)  was  required  to  achieve  this  per¬ 
formance. 


Threshold  Investigation  of  a  Widaband.PLL  Design 


Only  sinusoidal  modulation  was  employed  in  this  portion  of  our  simu- 

,(fc-  -  ,  f 

lation.  An  ideal  zonUl  (low-pass)  filter  with  a  cutoff  frequency  equal  to  the 
modulation  frequehd^'  wh..s:'as  sumed  in  the  theoretical  PIB  model.  For  pracl 


modulation  'frequehc.y  wh.S  'assumed  in  the  theoretical  PIB  model.  For  practi¬ 
cal  reasoh^V  '  the,,po'fet  loop  ^filter,  in  our  simulation  was  a  third  order  Butter- 
worth  filter  with  the  corner  frequency  equal  to  the  modulation  frequency  of 

i  ,  .  •  '  >  V. 

10  radians,  per  second.  ,  The  design  of  the  loop  filter,  for  a  modulation  index 
equal  to  10',  was/,:darriedf6£t.  iii  accordance  with  the  PIB  report.  The  damping 
coefficient -of the  closed  loop  transfer  function  was  adusted  for  maximum 


flatness,,  which!  incidentally,  results  in  a  second  order  Butterv/orth  filter. 

,  '  \ 

This  procedure,  does  indeed  result  in  a  loop  bandwidth  which  is  wide  compared 
to  the  modulation  frequency.  In  fact,  this  design  resulted  in  a  loop  bandwidth 
approximate!.^  53  times  the  modulation  frequency  with  the  loop  designed  for  a 
modulation  i$dex;  equal  to  10.  This  design  approach  appears  to  be  in  general 


agreement  with, jtfie  loop  design  which  results  from  the  minimum  mean-square 
error  apprqfabhefhployed  in  the  previous  phase  of  this  simulation.  That  is, 
both  appr oafchei? Ij»ad  to  a  loop  bandwidth  which  is  much  wider  than  the  band¬ 
width  of  the  xmcfdplation  signal. 

Thq  Simulation  of  the  PIB  PLL  was  carried  out  in  much  the  same  way 
as  the  other  piijj  simulation  described  earlier  in  the  chapter.  However,  in 
this  particular  model  a  sharper  cutoff  post-loop  filter  was  employed  in  order 
to  be  in  cftbse  Agreement  with  the  PIB  model.  As  a  result,  a  significant  phase 
shift  w;d's|;ihtr9^ce(i  by  the  post-loop  filter  at  the  modulation  frequency.  A 
satisf^ctj^Vy  nidan- square  error  measurement  was  easily  made  near  and  below 


threshold;  however ,  at  very  high  output,  signal-to-noise  ratios  above 
threshold  the  total  mean-square  error  was  dominated  by  distortion  of  the 
modulation  signal. 

In  the  absence  of  modulation,  the  output  is  due  entirely  to  noise  and 
represents  the  total  mean-square  error  (with  respect  to  the  modulation, 
which  by  definition  is  set  equal  to  zero).  The  output  signal-to-noise  ratio 

rr~2 

is  plotted  in  terms  of  'hCe~  computed  as  if  a  modulation  signal  of 
power  ( was  present.  The  origin  of  the  ordinate  has  been  adjusted  so  as 
to  bring  the  experimental  results,  which  were  recorded  only  on  a  relative 
basis,  into  agreement  with  the  known  asymptotic  results  at  high  carrier -to- 
noise  ratios.  The  value  of  the  intrinsic  input  carrier-to-noise  ratio,  (S/N)., 
at  which  threshold  occurs,  is  quantitatively  oLtained  from  the  abscissa. 

The  threshold  curves  of  Figure  V-9  show  the  threshold  performance 
without  modulation  for  five  different  loop  bandwidths  from  50  to  530  radians 
per  second.  The  post-loop  filter  had  its  -3  db  point  at  the  modulation 
frequency  of  10  radians  per  second.  When  the  modulation  signal  was  added 
in  the  narrow  bandwidth  loop,  the  loop  was  observed  to  skip  cycles  even  in 
the  absence  of  noise.  The  noise-free  skipping  could  not  be  eliminated  until 
loop  bandwidths  of  200  radians  per  second  or  higher  were  employed. 

Figure  V-10  shows  the  threshold  curves  with  and  without  modulation 
when  the  loop  bandwidth  is  adjusted  to  200  radians  per  second.  ,  In  this  case, 
the  threshold  occurs  at  approximately  5  db  greater  (S/N)^  when  .the  modu¬ 
lating  signal  is  present.  ' 

In  Figure  V-ll  with  the  wideband  loop,  we  see  that  the  influence  of  the 

< 

modulation  function  is  much  less  (approximately  1  db)  than  with  the  narrower 

* 

loop  bandwidth  systems.  However,  it  was  observed  that  the  threshold  with 

\ 

modulation  was  not  a  very  sensitive  function  of  the  loop  bandwidth^  and  in 
fact,  the  threshold  is  seen  to  occur  at  approximately  the  same  input  carrier- 
to-noise  ratio  with  either  of  the  two  largest  loop  bandwidths.  \ 

As  a  result  of  this  simulation  we  find  the  threshold  occurs  atlsomewhat 
higher  carrier-to-noise  ratios  than  indicated  in  the  PIB  report  and  , appears 
to  be  consistent  with  most  other  PLL  results  which  indicate  that  a 
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Figure  i-9  SIMULATION  OF  PLL  PERFORM 
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AS  A  FUNCTION  OF  LOOP  BANDWIDTH 


Figure  1-11  SIMULATION  OF  WIDE-BANO  PLL  FM  DEMODULATOR 


threshold  improvement,  with  respect  in  ^discriminator,  can  be  achieved 
with  conventional  PLL  systems,  for  the  values  of  Jl  normally  encountered. 

\ 

6.  Comparison  with  the  Discriminator  \ 

\ 

V 

It  is  interesting  to  compare  the  results,  of  this  simulation  with  the 

threshold  characteristics  of  a  conventional  FM  receiver  employing  a 

discriminator.  Figure  V-12  is  a  plot  of  the  ihput\ca?yier-to-noise  power 

ratio  at  which  threshold  occurs  as  a  function  of  the -.bandwidth  expansion 

» 

factor  in  an  FM  system.  The  data  for  the  discriminator  was  taken  from  the 

[7]:  V 

well  known  curves  derived  by  F.  J.  Skinner. L  Two  joints'  f r cm  our  simula¬ 
tion  using  a  sinusoidal  modulation  signal  are  also  sho\kn.  The  lower  curve  is 

[2]  .  \ 

taken  from  a  paper  by  Akimac  1  in  which  he  theorized:  how  far  the  threshold 
extension  can  be  carried  in  a  realizable  system.  It  is  Sfeen  that  the  perform¬ 
ance  obtainable  with  the  PLL  demodulator  is  significantly /better  than  the 
discriminator,  but  falls  well  short  of  the  Akima  limit.  It  -'should  further  be 
noted  that  other  theoretical  studies  such  as  described  in  Chapters  II  and  IV 
of  this  report  suggest  that  the  threshold  may  possibly  be  intl^roye^well 
beyond  the  Akima  Limit,  particularly  if  nonreal  time  processing  is;  employed. 


7.  Conclusions  k 

\ 

1)  It  is  concluded  that  the  use  of  a  hybrid  computer  singulation  is  a 

J 

useful  and  accurate  technique  for  evaluating  the  threshold  performance  of 
PLL  demodulators.  This  technique  can  be  extended  to  investigate  the  , 
performance  of  even  more  complex,  structures,  such  as  a  frequency  demodu¬ 
lator  with  feedback  when  a  PLL  is  employed  as  the  frequency  detector  in  the 
FMFB  loop. 

2)  As  noted  earlier  in  this  chapter,  a  previous  effort1  1  established 
the  relationship  between  the  MAP  estimation  of  an  FM  signal  and  £  closed 
loop  configuration  which  required  a  nonrealizable  loop  filter.  Howfever,  the 
potential  threshold  extension  of  an  infinite -delay  MAP  estimator  cSnnotvbe 
realized  with  a  zero-delay  PLL.  Furthermore,  there  is  no  proof  t’jiat  the 
conventional  PLL  structure  lepre&ents  even  a  very  close  approximation’ to 
the  best  possible  realizable  system.  It  is  suggested  that  this  simuljatioq 
approach  be  used  to  investigate  modified  PLL  designs  which  may  Itjad  to 
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improved  realizable,  z ero -delay  FM  dfei^diilafprs.  Among  these  would  be 
various  PLL  structures  in  which  a  mo<Jified;:phas;e  detector  characteristic  is 
employed.  This  would  include  such  techniques-  an.  'Linlock^,  Tanlock^, 


"  V.  fidi 

and  the  Extended  Range  Phase  Detector-  (ERPJ5)..  -  ^  One  should  not  restrict 
these  efforts  simply  to  modifications  of  the  pha^e  detector  in  a  PLL  system 
but  consider  improvements  to  the  FMFB  demodulator  or  other  techniques 
that  take  advantage  of  the  particular  manner  in  wl^ch  the  additive  noise  and 
an  FM  signal  interact.  /,  \ 

3)  A  significantly  better  FM  demodulator  ma^  be- possible  if  the 

application  does  not  require  realtime  processing.  iT^  operation  specified 

by  the  infinite  delay  MAP  analysis  could  be  closely  approximated  if  the 

received  signal  plus  noise  were  available  in  stored  fprcr^,  as  for  example-  by 

recording  the  I.  F.  signal.  Demodulation  might  require  computer  processing 

\ 

and  would  entail  some  delay,  at  least  of  the  order  of  the  correlation  time  of 
the  modulation,  before  the  estimate  of  the  modulation  could  be  formed.  In 
many  applications  the  delay  could  be  so  small  that  these  systems  v/ould  be 
entirely  practical  in  situations  where  "realtime"  demodulators  are  ordinarily 

thought  to  be  a  necessity.  <. 

\ 

The  intensive  efforts  made  by  many  investigators  over  the  past  several 
years  notwithstanding,  there  is  no  evidence  that  the  limiting  performance  of 
angle  modulated  systems  has  been  attained,  and  we  anticipate  4hat  significant 
improvements  in  performance  will  be  achieved.  Two  of  the  motet  promising 
approaches  seem  to  be  the  use  of  a  modified  phase  detector  and'.the  develop- 
ment  of  practical  approximations  to  the  "infinite-delay"  MAP  or>MMSE 
estimators  in  situations  where  a  small  processing  delay  is  tolerable. 


APPENDIX  ‘V  -  A 

SYNTHESIS  OF  THE  LC^Sp  A&D  POST  LOOP  FILTERS 

/ 

i 

The  procedure  for  synthesizing  the  loop  and  post-loop  filters  of  the 
low  frequency  equivalent  circuit,  of  Figure  V-3  is  described  in  this  Appendix. 
In  accordance  with  the  design  suggested  from  the  MAP  estimation  theory, 
the  transfer  functions  of  tne  filters  are  obtained  by  applying  least  square 
error  filtering  theory  to  Jthe  linearized  model  shown  in  Figure  V-1A.  The 
loop  filter  F(s)  is  synthesized  so  as  to  minimize  the  mean-square  phase 
error  in  the  linearized^lqqp.  Then,  with  F(s)  defined,  the  post-loop  filter, 
G(s),  is  chosen  to  minimize  the  mean ^ square  error  between  the  modulation 
function  a(t)  and  the.  demodulat' or  output,  a(t). 


Figure'll  A 

fl/jV 

Let  v  be  the  closed  loop  transfer  function  which  minimizes 


the -phase  error ,  0 (t)  -  9  ft) . 

r.w.  u  (. 


u  (5)  -  Yf _ t— 

(5)  ,  s  /r,  F(S) 

Tz  s 


(A-l) 


f(s)  = 


h-efc  afsj  ~  ^  be  the  , transfer  function  which  minimizes  the 

difference  between  the  modulation  furicjtioiJv  a(t)  and  the  demodulator  output 

\  V 

Thus  Nz  (s)  -  S—  &h{)  - //;<*)&&)  (A -3) 


Thus 


n.,  s.—  &($y-//,Xs)GCs) 


'  N,(S) 


(A -4) 


V 

Initially  in  the  experiment  we  used  a  random,  modulation  function 

ir 

obtained  by  passing  white  Gaussian  noise  througha.  third  order  Butterworth 

■ '  ’ 

filter  resulting  in  a  modulation  spectrum  , 


5a  (S)  ja 


At  Co* 

-S6+ 


(A -5) 


v.  i 

The  equivalent  additive  noise  was  obtained  from  a  white  Gaussian 
noise  source,  independent  of  the  modulating  signal,  haying  a^power  spectral 


density 


4r,  &  = 


The  power  spectral  density  of  9(t)  is  given  by 

2  6 

S&  (s)  = _ COe _ 

°  -S*(-S6+u)*) 


\ 

X 

■ 

A 


(A-6) 


(A-7) 


The  closed  loop  part  of  Figure  V-1A  may  be  redrawn  as  shown 


Figure  Y-2A 
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The  filter  which  results  in  the  ^liiiimuni  mean-square  loop  error 
is  determined  in  terms  of  the  powei/  spectral  densities  of  the  input  signal 
and  noise  by  t / 


Hi  &  = 
/ 


(A-8) 

(A- 9) 


where  S^fs)  -  S#(s)  -  Sg(s)  +■  S/tCs)  (A- 9 

/ 

/ 

and  possesses  all  the  poles  and  zeroes  of  (s)  that  lie 

in  the  left  half-plane  and  none  of  those  that  lie  in  the  right  half-plane. 

The  symbol  [  ]  implies  that  the  function  f  -^=■7-7]  has  been 

expanded  into  the  form  where  the  first 

term  has  only  left  half-plane  poles  and  the  second  has  only  right  half-plane 
poles.  It  follows  that  the  inverse  Laplace  transform  of  [ ^ j j  +  is 
equal  to  zero  for  :  £  <  O  ,  and  X  ^  j  ~j-  is  zero  for  t  >0. 

So  (s)  =  do 

*  2 
1  mi  P  6 


c  _  BAfo  +  TTTT^e 

-s*{-S*  +  «gT 


J3(s)/3(-s )  =  -S^-S^uJc) 


j~z  /3A-\  v  OstC&J  ~  /  “  ,  — — rr 


&  J3(-S ) 


(A- 10) 

(A- 11) 
(A- 12) 

(A-13) 
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Upon  substituting  in  Equatiori(A.-8)\pii'e;;obtains 


C  s )  - 


r  i 

/ 3(S)/3C-S ) 

•\ 

r  .  .  ] 

1 

V)  v? 

'vj  V. 

•rf  ^ 
kj'U 

[gN 
_ j 

+  _ 

?\.  a  ..  .  -1 

fZAfg  cCfS) 

i  s?  fi<s' 


'}2M>  \  <Z'(sX 


1  ^0 


(A- 14) 
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H  „2 


*(*)*&•>  - 


(A- 15) 


——  *£  =  ~  0s)  0-0 


then- 


M)  = 


i  {[Mi-ist-f 


oC(S) 

/3<s) 


\  m&'  :\ 

V  y3<% 


=  ,-^Sl 

sec®; 


\\ 

\  V., 


\  ' 


1  ■ 


t: 

V  V  .f! 


(A-16) 


(A- 17) 


°C(s)  may  be  determined  by  use  of  Ferrari's  s olution  pfjthe  general 
quartic  equation,  and  J3(s)  by  use  of  Tartaglia's  solution  of  the  general 
cubic  equation^ ^  • ':L 


W e  have ,  fr om  Equation  (A - 1 1 ) 


•I 


cCCs)oC(-S)  =  s*-cof  s*+  S20Uc 


.. 

.  vl 


where 


% 


v.l 
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/ 

oCCSJ  contains  all  the  realizable  roots,  i.e. ,  all  roots  in  the  left 
half-plane  and  cC(~s)  contains  all  the  roots  in  the  right  half-plane.  The 
roots  in  the  right  half-plane. are  mirror  images  of  the  roots  in  the  left 
half-plane,  thus,  by  finding  the  roots  of  SZ  and  then  taking  the  square 

root,  the  desired  factorization  of  the  roots  can  be  obtained.  Applying 
Ferrari’s  method,  we  obtain 

ot(s)  =  s a3  S3  +  az  sz+  djs+ao 

aQ  =  suic3 


Thus  the  loop  filter  is 


r(s)  = 


_  YT  's'C^s)-rfi(sS) 


£c.  WO* 

V 


The  next  step  is  to  determine  the  output  iilter  G(s).  The  model  of  the 

\  ' 

linearized  phase-locked  loop  can  be  redrawn  in  the  following  form: 

v,  f+\ I  MjX?)  v  \\ 

»‘ij\  i - : - t — i 

¥  +  ,  .  A  , 


where 


MCs)  — ^  *r(s)  r-j 


Figure  I-3A 


3.(5)= 

^  '  -  s  6  *  &J, > 


^Cs)-  ~s2  ] 

fy(s)  —  H,  (s)  G}(s) 


SACs)  -  Sa(s)  +  Sn(s)~  %™)/3(-h  \ 


Hz(s)  = 


\  Stt(s)  1 

L^cs)  J  + 
Si  fs) 


/ 

AS 


H,  ft)  = 


ZA/0  C 

£>* _ Vza4  s 

o^ocf-s)  '  /9ft> 


s  2^ 

/Sfs) 


^  =  *($bC(-s) -Jify/Sf-s) 


// 
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. jrfs)  =  Sf■^d3S3^ct^S^td1  s ->ci„ 


I  '}■&  =  S*+t,  s*  +  itS**b,S 

ptH™  *£$&' 0 contains  ?nly  r“a**ble  parts- 

L.»  i  f/3r-s)  1 

|T.he  pjtxn,  S  [lrcr^'^ contains  realizable  and  nonrealizable  parts, 
but  bf  expanding  and  dividing,  the  realizable  part  can  be  extracted. 


■J  .  f 
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-3 


=  (~s) 


X('S)^ 

k‘dc-^[<?r  b& *  aQ 

C-s)^4  a  3  s)3  -f-  a2  fi  siF+at<y$  *a 


-^3 

C“  +  -  ^2.. 

]  r-s)3  +: 

r  VS  -i 

[*&-£}? 

e##8*  ^6S) 

(-sy  +  <33(-s)z*  a*(-s)**  a^-s^v  a,- r 

=  £a3  -  i?3J  ■+  nonrealizable  parts 


Sf'^-i’l  "  \d3  ~bi\ 

Then  ^  -1  L _ J 

$  oCC  5~) 


AC*) 


»M  =  *  - 
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oC(s)  l 
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[<3 3  -  b  3~\ 


\  ■  . 
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:\- 

V-,. 

v,^ 

>  i 
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V  ' 

\ 

•\ 
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H,  (s)  =  /- 


/?6) 

«<0) 


From  Equation  (A-2) 


t 

\' 


•y 
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>  [*(s)-/S(s>] 


JL  rrs)  -  s  =  s'  I 
IT  F(5)  5  /-»&  S  /S& 


Hz  (s)  =  Hi  (s)  df  (s) 
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